 |
 |
⚡ GitHub Stats
⚡ Most Used Languages
def UpgradeFunction():
message = "Upgrading my skills [Py Version!]"
return messageThe MockData Generator is a tool that allows, through some configurations, to create random records in a document with a '.csv' format or '.sql' for tables, based on their column structure and thus later to be able to load them into bigdata.
Main <- You will find the module in charge of running the entire script here.
FileHandle <- You will find the module in charge of opening and creating files here.
GetData <- You will find the module in charge of collecting data and creating the mockdata here.
Search <- Module in charge of searching if a file with old data already exists.
Create <- Module in charge of creating the data according the configurations (SQL or CSV).
➡️ Install the libraries specified in 'requirements.txt' Especially the Faker library
➡️ First of all, you have to pass some parameters for the script to work correctly, we will detail below.
➡️ Inside of "Configurations.json" file.
{
"Configurations":{
"DatasetName":"MyDataset",
"DatasetFileToOpen":"MyDataset.config.json",
"NameOfDatasetToSaveInJson":"MyNewDataset.json",
"Directory_To_Save_csvFiles":"CSV_Files",
"Directory_To_Save_jsonFiles":"JSON_Files",
"Directory_To_Save_sqlFiles":"SQL_Files",
"SQL_Format":true
}
}➡️ The field 'DatasetName' refers to the name of the dataset in question, this field will be used as part of the name of the files generated by the script (the csv with the datamock and the json with the pk of each dataset table).
➡️ The field 'DatasetFileToOpen' refers to the file that the script will open, where the table settings must be inside to be able to do the mocking data.
➡️ The field 'NameOfDatasetToSaveInJson' refers to the file with json format that the script will generate, where it will contain the pk of each of the dataset tables, the recommended format is: NameOfTheDataSet.json, where 'NameOfTheDataSet' will be the name of the data set.
➡️ The field 'Directory_to_save_csvFiles', 'Directory_to_save_jsonFiles' and 'Directory_to_save_sqlFiles' refer to the directories that will be created to store the csv, json and sql files respectively, generated by the script.
➡️ The field 'SQL_Format' refers if the file created is in format sql (true) or csv (false).
➡️ The name of this file must be the one specified in 'DatasetFileToOpen' in the 'Configurations.json' file. The configuration instructions can be found in the following Link
➡️ As mentioned before, the libraries contained in 'requirements.txt' must be installed for their correct operation. The script will open the Configurations.json file to save the variables set by the user in its environment, it will search if there is already a json with tables and pks in the directory to avoid re-creating those tables and stepping on the old existing data. It will use the variable 'DatasetFileToOpen' to open the file with the dataset table structure and thus be able to iterate each of the dataset tables and within them, each of the column structures. As each column iterates, it will generate its data based on your settings. Later create a csv with said data for each table as well as a json file containing all the stations of each table.
The script does not create data following a logic, but creates random data following the configuration patterns of the dataset.
This project is under license [GNU v3] - read the file LICENSE.md for details.
 |
|
|---|---|
 |
 |
|
|---|---|
| 🤴 Facu Falcone | Junior Developer |
 |
Github |
 |
|
 |
CafecitoApp |
 |
Ko-Fi |
| ⬆️ Go Top | ➡️ Go to Faker WebPage |