Skip to content

Releases: simw/pipedata

v0.3

23 Jan 16:21
8d3888d
Compare
Choose a tag to compare

What's Changed

  • Refactor code to make simpler by @simw in #12

Full Changelog: v0.2.2...v0.3

v0.2.2

14 Nov 11:37
dde1b41
Compare
Choose a tag to compare

What's Changed

  • Add additional logging to read_from_parquet by @simw in #11

Full Changelog: v0.2.1...v0.2.2

v0.2.1

14 Nov 08:53
ac36067
Compare
Choose a tag to compare

What's Changed

  • Add read_from_parquet operation by @simw in #10

Full Changelog: v0.2...v0.2.1

v0.2

13 Nov 09:55
3c9980b
Compare
Choose a tag to compare

What's Changed

  • Update zipped_files to return name as well as contents; update json_records and csv_records to take new structure; bump to 0.2 by @simw in #9

Full Changelog: v0.1.1...v0.2

v0.1.1

08 Nov 12:59
146285e
Compare
Choose a tag to compare

What's Changed

  • Update installation instructions in README by @simw in #7
  • Make parquet file writing start at 1 rather than 0, for ease of reading by @simw in #8

Full Changelog: v0.1...v0.1.1

v0.1

07 Nov 20:02
79955e2
Compare
Choose a tag to compare

Adding data processing functionality.

What's Changed

  • Cleanup by applying more in-built python functionality for iterators by @simw in #5
  • Add data operations for reading from zip, iterating over csv and json records, and writing to parquet by @simw in #6

Full Changelog: v0.0.1...v0.1

v0.0.1

07 Nov 10:50
8ae76d2
Compare
Choose a tag to compare

Initial release with core functionality.

What's Changed

  • Initial structure for the repo by @simw in #1
  • Add chain and stream classes, to enable combining operations by @simw in #2
  • Add map, reduce and map_tuple operations, for ease of use by @simw in #3
  • Refactor in order to be able to get more data about the operations run in the pipeline by @simw in #4

Full Changelog: https://github.com/simw/pipedata/commits/v0.0.1