Really rethink the interactive flow

[bastienboutonnet]

I find this flow a bit of a joke, it's also bad looking.

Few ideas

• pandas truncates things we should be able to provide a list of columns to print.
• rendering of tables should use something more appropriate for GUIs
• ability maybe to search/test for things. Such as:
  • are there nulls
  • are there dupes
  • are there empty strings
• ability to do some quick describes (find out null values, distinct etc).

Of course we don't want this flow to be TOO feature rich and for each feature we provide we should probably make sure that the interactive flow can provide a fix or solution that can be implemented in the interactive flow and standardised as rules maybe? -- Although maybe fixes get too much in the territory of ETL. So maybe we could have a flow that rather than offer a fix, offers a way to print a history of checks done in the interactive flow...

I'm wondering actually how needed this feature would be.

It's quite a bit of work to create good UIs and if that feature isn't going to be used much then maybe we shouldn't really bother in developing this too much.