DataSync 0.2
You are now able to upgrade to the newest version of DataSync - version 0.2 ( download link below ). If you already have DataSync installed, the next time you open DataSync you will see a prompt to update your version to the current one. If you do not have the previous version of DataSync installed you can download version 0.2 below.
This release of DataSync comes with enhancements and new features, many of which are based off of customer requests:
- Automatic chunking of large files: Uploading very large files (200 MB or larger) was not possible with the previous version of DataSync due to hitting publisher API filesize limits. DataSync can now handle large files with ease by splitting them up and publishing them in separate “chunks” (files larger than 75 MB are automatically chunked). DataSync 0.2 has been tested with files larger than 200 MB. NOTE: file chunking is only supported by the ‘upsert’ and ‘append’ (not ‘replace’). Replace will support chunking in the future.
- Use DataSync to copy a dataset or dataset blueprint (schema) quickly: DataSync™ now has a function allowing you to make copies of existing datasets on one domain or across two different domains. You can copy the dataset blueprint (schema) without any data or the dataset along with all rows of data. DataSync now has a new job type called a “Port” job which supports this capability.
- Better Error Handling: DataSync now has further improved error messages to help troubleshoot issues with publishing data.
- Major Bug Fix: Due to a fix made in the soda-java library (version 0.9.4) publishing via 'upsert' and ‘append’ on certain datasets will no longer cause an error (UnrecognizedPropertyException).
- Migration to Maven: Developers can now use Maven for package management (rather than importing JARs as external libraries) - to move mail and to import soda-java and org.json packages
Want to leave a question, comment, suggestion or bug report on DataSync 0.2?
You can now submit these within the DataSync Github repository issue tracker - all you need is a free GitHub account.
Check the repository to keep up to speed with new features on the roadmap and deploy schedules for future versions.
Related Links:
- Setting up a basic DataSync job
- Integration Class Webinar - in which our integration experts go over a few of the integration options compatible with the Socrata platform, including DataSync. You can register for the next live webinar here: http://discover.socrata.com/socratauniversity.html