Support Compressed Streams in IngestFromStream

BREAKING CHANGES:

• None.

FEATURES:

• ingestFromStream now supports compressed streams using streamDescriptor (GZIP, ZIP).

FIXES:

• Error that was sent on stream will now invoke callback (#57 )

Orc Format

BREAKING CHANGES:

None

FEATURES:

Support orc format

FIXES:

• Fix response in case of error

Fix Response in Case of Error

BREAKING CHANGES:

None

FEATURES:

None

FIXES:

• Fix response in case of error

Fix Response Parsing

BREAKING CHANGES:

None

FEATURES:

None

FIXES:

• Fix Json response parsing

Introducing Streaming Ingest Client

Streaming ingest is used to ingest small chunks of data directly to the engine.
Streaming ingest feature should be enabled on the target cluster and database/table - to read more about streaming ingestion see Streaming ingestion (Preview)

BREAKING CHANGES:

None

FEATURES:

Streaming ingest client - provides methods to ingest from ReadStream and local files.

FIXES:

None

Support for Setting AadAuthorityUri Using an Environment Variable

BREAKING CHANGES:

None

FEATURES:

• If the use of a non-default AadAuthorityUri is needed, set environment variable AadAuthorityUri to the required uri.

FIXES:

None

Support for new Ingestion Mapping API and Format

BREAKING CHANGES:

• Parameter for IngestionProperties constructor is now an object, instead of a list of parameters.
• IngestionProperties object supports the new Ingestion Mapping API and formats:
  1. ingestionMapping replaces the deprecated mapping.
  2. ingestionMappingType.
  3. ingestionMappingReference replaces the deprecated mappingReference.
• Changed DataFormat ENUM to be all caps, e.g DataFormat.csv is now DataFormat.CSV

FEATURES:

• Fully supports Parquet ingestion.

FIXES:

• When ad-hoc ingestionProperties were given to an ingest command, a few default ingestionProperties were unnecessarily edited when the two objects were merged.

Fix error when command is preceded by whitespace characters

BREAKING CHANGES:

None.

FEATURES:

None.

FIXES:

• Before the fix, if a client executed a command preceded with certain whitespace characters (e.g. .show version), an error would occur.
  Now, the command is trimmed before it's sent to the cluster.

Managed Identity Support

BREAKING CHANGES:

None.

FEATURES:

• Added support for managed identity.

const kcsb = KustoConnectionStringBuilder.withAadManagedIdentities(`https://${clusterName}.kusto.windows.net`, '(Optional)msiEndpoint', '(Optional)clientId');

FIXES:

None.

Exposing source id

BREAKING CHANGES:

None.

FEATURES:

• Add the ability to set the source id of source descriptors. Useful for monitoring purposes (when reading statuses from queue, can correlate status via IngestionSourceId on status message).

const uuidv4 = require('uuid/v4');
let sourceId = uuidv4();
let fileDescriptor = new FileDescriptor("stormEvents.csv", sourceId);

ingestClient.ingestFromFile(fileDescriptor, ingestionProperties, (err) => {
//set up status queue monitoring..
});

FIXES:

None.