1. 08 Oct, 2015 1 commit
    • Douglas's avatar
      refactoring to array population and write formats · 8c54b4f4
      Douglas authored
      - array is now populated by in-memory size and the number of rows is calculated automatically;
      - array is populated using chunks of data to save some memory;
      - parameter to choose between format ZBlk0 (one zodb object) and ZBlk1 (group of zodb objects).
      8c54b4f4
  2. 01 Oct, 2015 4 commits
    • Douglas's avatar
      Added todo about parameterizing schema generation · a2dd4281
      Douglas authored
      It should be possible to chose between a normalized and a not normalized schema in the future.
      a2dd4281
    • Douglas's avatar
      big refactoring to how to test works · 6f2b1454
      Douglas authored
      - new context manager to measure code's performance
      - now creates and fill arrays by memory size and not number of rows anymore
      - only 1 row from mariadb is broadcasted to the entire array (doesnt spend a lot of time waiting mysql anymore)
      - removed useless profile functions (just from this repository)
      - added docstrings
      - added pure wendelin.core/numpy sum test along with pandas
      6f2b1454
    • Douglas's avatar
      performance test improvements · cd432f09
      Douglas authored
      - added the disk size of the array object in zodb
      - fixed profiling methods
      - created a context manager to help time pieces of code
      - timing numpy.sum() along with pandas.DataFrame.sum()
      cd432f09
    • Douglas's avatar
  3. 29 Sep, 2015 1 commit