Regression

demonstrator_test.DemonstratorTestCase.test_topic_modeling (from nosetests)

Error Message

'generator' object has no attribute 'as_matrix'
-------------------- >> begin captured stdout << ---------------------
Accessing user input ...
1 text files.
1 topics.
1 iterations.
Using external stopwords list.
Tokenizing <FileStorage: 'document.txt' ('text/plain')> ...
Accessing external stopwords list ...
Determining hapax legomena ...
Removing stopwords and hapax legomena from corpus ...

--------------------- >> end captured stdout << ----------------------
-------------------- >> begin captured logging << --------------------
dariah_topics.preprocessing: DEBUG: Tokenizing document ...
dariah_topics.preprocessing: DEBUG: Lowering all characters ...
dariah_topics.preprocessing: INFO: Creating document-term matrix for small corpus ...
dariah_topics.preprocessing: DEBUG: Updating document in document-term matrix ...
dariah_topics.preprocessing: INFO: Determining hapax legomena ...
dariah_topics.preprocessing: DEBUG: Small corpus model ...
dariah_topics.preprocessing: DEBUG: Tokenizing document ...
dariah_topics.preprocessing: DEBUG: Lowering all characters ...
--------------------- >> end captured logging << ---------------------

Stacktrace

  File "/usr/lib/python3.5/unittest/case.py", line 59, in testPartExecutor
    yield
  File "/usr/lib/python3.5/unittest/case.py", line 601, in run
    testMethod()
  File "/mnt/data/jenkins/workspace/DARIAH-Topics/test/demonstrator_test.py", line 57, in test_topic_modeling
    resp = self.app.post('/upload', data=data)
  File "/mnt/data/jenkins/shiningpanda/jobs/62c67c92/virtualenvs/d41d8cd9/lib/python3.5/site-packages/werkzeug/test.py", line 801, in post
    return self.open(*args, **kw)
  File "/mnt/data/jenkins/shiningpanda/jobs/62c67c92/virtualenvs/d41d8cd9/lib/python3.5/site-packages/flask/testing.py", line 127, in open
    follow_redirects=follow_redirects)
  File "/mnt/data/jenkins/shiningpanda/jobs/62c67c92/virtualenvs/d41d8cd9/lib/python3.5/site-packages/werkzeug/test.py", line 764, in open
    response = self.run_wsgi_app(environ, buffered=buffered)
  File "/mnt/data/jenkins/shiningpanda/jobs/62c67c92/virtualenvs/d41d8cd9/lib/python3.5/site-packages/werkzeug/test.py", line 677, in run_wsgi_app
    rv = run_wsgi_app(self.application, environ, buffered=buffered)
  File "/mnt/data/jenkins/shiningpanda/jobs/62c67c92/virtualenvs/d41d8cd9/lib/python3.5/site-packages/werkzeug/test.py", line 884, in run_wsgi_app
    app_rv = app(environ, start_response)
  File "/mnt/data/jenkins/shiningpanda/jobs/62c67c92/virtualenvs/d41d8cd9/lib/python3.5/site-packages/flask/app.py", line 1997, in __call__
    return self.wsgi_app(environ, start_response)
  File "/mnt/data/jenkins/shiningpanda/jobs/62c67c92/virtualenvs/d41d8cd9/lib/python3.5/site-packages/flask/app.py", line 1985, in wsgi_app
    response = self.handle_exception(e)
  File "/mnt/data/jenkins/shiningpanda/jobs/62c67c92/virtualenvs/d41d8cd9/lib/python3.5/site-packages/flask/app.py", line 1540, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/mnt/data/jenkins/shiningpanda/jobs/62c67c92/virtualenvs/d41d8cd9/lib/python3.5/site-packages/flask/_compat.py", line 33, in reraise
    raise value
  File "/mnt/data/jenkins/shiningpanda/jobs/62c67c92/virtualenvs/d41d8cd9/lib/python3.5/site-packages/flask/app.py", line 1982, in wsgi_app
    response = self.full_dispatch_request()
  File "/mnt/data/jenkins/shiningpanda/jobs/62c67c92/virtualenvs/d41d8cd9/lib/python3.5/site-packages/flask/app.py", line 1614, in full_dispatch_request
    rv = self.handle_user_exception(e)
  File "/mnt/data/jenkins/shiningpanda/jobs/62c67c92/virtualenvs/d41d8cd9/lib/python3.5/site-packages/flask/app.py", line 1517, in handle_user_exception
    reraise(exc_type, exc_value, tb)
  File "/mnt/data/jenkins/shiningpanda/jobs/62c67c92/virtualenvs/d41d8cd9/lib/python3.5/site-packages/flask/_compat.py", line 33, in reraise
    raise value
  File "/mnt/data/jenkins/shiningpanda/jobs/62c67c92/virtualenvs/d41d8cd9/lib/python3.5/site-packages/flask/app.py", line 1612, in full_dispatch_request
    rv = self.dispatch_request()
  File "/mnt/data/jenkins/shiningpanda/jobs/62c67c92/virtualenvs/d41d8cd9/lib/python3.5/site-packages/flask/app.py", line 1598, in dispatch_request
    return self.view_functions[rule.endpoint](**req.view_args)
  File "demonstrator/demonstrator.py", line 148, in upload_file
    doc_term_arr = doc_term_matrix.as_matrix().astype(int)
'generator' object has no attribute 'as_matrix'
-------------------- >> begin captured stdout << ---------------------
Accessing user input ...
1 text files.
1 topics.
1 iterations.
Using external stopwords list.
Tokenizing <FileStorage: 'document.txt' ('text/plain')> ...
Accessing external stopwords list ...
Determining hapax legomena ...
Removing stopwords and hapax legomena from corpus ...

--------------------- >> end captured stdout << ----------------------
-------------------- >> begin captured logging << --------------------
dariah_topics.preprocessing: DEBUG: Tokenizing document ...
dariah_topics.preprocessing: DEBUG: Lowering all characters ...
dariah_topics.preprocessing: INFO: Creating document-term matrix for small corpus ...
dariah_topics.preprocessing: DEBUG: Updating document in document-term matrix ...
dariah_topics.preprocessing: INFO: Determining hapax legomena ...
dariah_topics.preprocessing: DEBUG: Small corpus model ...
dariah_topics.preprocessing: DEBUG: Tokenizing document ...
dariah_topics.preprocessing: DEBUG: Lowering all characters ...
--------------------- >> end captured logging << ---------------------

Standard Output

Accessing user input ...
1 text files.
1 topics.
1 iterations.
Using external stopwords list.
Tokenizing <FileStorage: 'document.txt' ('text/plain')> ...
Accessing external stopwords list ...
Determining hapax legomena ...
Removing stopwords and hapax legomena from corpus ...