38. Data Preparation

PREPARING DATA
When starting an AI project, 80% of the work is on cleaning data for the model. In most cases, the data are not clean and the data source is not centrally managed.
That’s when a data management platform comes in handy. The diagram below is a data management/processing platform we are currently working at.



STEP.1 CENTRALIZE SOURCE
By importing the data from various sources to the platform, the user will no longer need to go back and forth between data sources depending on what they want to see.

STEP.2 CUSTOM PROCESSING METHODS
We see many platforms that help process data but the processing methods that are available are usually fixed, even though processing methods that are ACTUALLY USEFUL differ depending on data structure and what kind of work the user is doing. So we are planning to add the capability of implementing a user-specific custom method.

STEP.3 USER-FRIENDLY OPERATIONS
The users will be able to execute the user-specific methods registered in STEP 2 using your mouse and do other basic actions such as SAVE and DELETE of the data

FOR OUR NEXT STEP
We are now asking our current clients for feedback on what kind of data pre-processing would help.