Locoia
Search…
Data Warehouse Helper

Insert or update data

The data warehouse helper allows you to store various types of data, e.g. even complex structures, like JSONs will be stored flat.
Possible input values:
    Value reference - the data object that you want to store in the Data Warehouse.
    Primary key column - The primary key on which you want to deduplicate, e.g. usually ID.
    Data source ID - a data source id of a data source that you previously generated so that one can store the data against it.

Nested JSON

Nested JSON structures will be automatically flattened, so that you don't have to do this anymore during the transformation step.
For example this is the nested input list of dictionaries:
1
[
2
{
3
"field_a": "value 123",
4
"my_nested_field": {
5
"another_field": 456,
6
"even_more_nested": {
7
"field_a": "example",
8
"field_b": true
9
}
10
}
11
},
12
{
13
...
14
]
Copied!
During the data insertion the nested JSON will be automatically flattened and the field name will be the json path, connected by _ (the nested structure will be preserved as well):
1
[
2
{
3
"field_a": "value 123",
4
"my_nested_field": {
5
"another_field": 456,
6
"even_more_nested": {
7
"field_a": "example",
8
"field_b": true
9
}
10
},
11
"my_nested_field_another_field": 456,
12
"my_nested_field_even_more_nested_field_a": "example",
13
"my_nested_field_even_more_nested_field_b": true,
14
},
15
{
16
...
17
]
Copied!
In case the column name generated by this exceeds 63 characters, the name will be truncated from the beginning (in order to keep the column name unique), e.g. my_very_long_field_name_that_is_also_nested_inside_another_dict_field_abc
Will be stored as:
ng_field_name_that_is_also_nested_inside_another_dict_field_abc

Retrieve from

Using the Retrieve from action, you can retrieve data from Data Sources, Transforms, and Insight, directly from a flow.
Possible input values:
    Source type - the source, e.g. data_source
    Source id - the ID of the source, e.g. the ID of the data source
    WHERE Statement - A WHERE statement that will be applied to the retrieval. The WHERE does not need to be written - optional
    Start Date - The start date in case the variable $start_date is used in the Insight that you're retrieving data from - optional (Insights only)
    End Date - The end date in case the variable $end_date is used in the Insight that you're retrieving data from - optional (Insights only)
Last modified 1mo ago