Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add support for multithreading and CSV data migration engine features #61

Open
ksulikow opened this issue Apr 30, 2021 · 3 comments
Open
Labels
enhancement New feature or request good first issue Good for newcomers

Comments

@ksulikow
Copy link
Contributor

Data migration engine has built in support for multithreading and CSV fields format, but it is not supported by package deployer. It can be easy implemented by adding additional config parameters and using data engine features.

@ksulikow ksulikow added enhancement New feature or request good first issue Good for newcomers labels Apr 30, 2021
@tdashworth
Copy link
Contributor

As an example, we can use what @ksulikow has added to the samples project for the migrator itself.

Capgemini/xrm-datamigration@ba8ac35

@tdashworth
Copy link
Contributor

tdashworth commented May 14, 2021

For configuration, I think we can add two optional parameters for type and threads count:

<templateconfig>
    <dataimports>
        <dataimport 
            datafolderpath="ConfigurationData/Extract"
            importconfigpath="ConfigurationData/ImportConfig.json"
            importbeforesolutions="true"
            type="json"
            threadcount="4"/>
    </dataimports>
</templateconfig>

The type property should default to json although if blank a warning message should be displayed stating:

Assuming JSON as data type for import. Please specify a type for this import using type="json" to prevent this message.

The threadcount property should default to 1 and no message needs to be shown.

@tdashworth
Copy link
Contributor

@ksulikow @ewingjm please take a look at my above comment and share any thoughts you might have. 😄

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request good first issue Good for newcomers
Projects
None yet
Development

No branches or pull requests

2 participants