📔DataOps

DataOps Tool

Introduction

Perform any data operations on tables in natural languages. For example: computing sum, counting, filtering, extracting data, etc.

This tool can be used to clean up and process data. You can perform many standard operations such as extracting and removing records, changing column names or values, and flattening and standardizing tables. Moreover, you can execute tasks that a standard spreadsheet cannot, such as removing duplicates. In addition, you can process text data as well.

Thanks to the power of ChatGPT, you can specify multiple and complex operations in one query, for example:

create a JSON list with account name, id, name, address. combine all address fields including cite, state, country into one. change id to org_id

Examples

Remove records with filter

Return a new list in the original format by removing records with org_name in the following list .... 

Extract records with filter

Return the first 5 items in the original format

Change column name

Return a new list in the original format with column get_org_by_name change to org_by_name

Remove duplications

Return a new json list in original format by removing duplication in the column company, use lower case when compare duplication

1. Do an operation on each record

With this tool, you can manipulate your data in various ways: remove a column, create a new column based on other columns, or explode a column whose values are lists, dictionaries, or tuples. Let's take a look at the following example:

Do an operation on each record

For each record, ...

This is a sample script for DataOps.