Data Source - MongoDB
- Print
- PDF
Data Source - MongoDB
- Print
- PDF
Article summary
Did you find this summary helpful?
Thank you for your feedback
summary
Help page for ETL Configuration from MongoDB.
constraints
none in particular
Setting items
STEP1 Basic settings
(data) item | indispensable | default value | Contents |
---|---|---|---|
MongoDB Connection Configuration | Yes | - | Select the previously registered Connection Configuration that has the necessary permissions for this ETL Configuration. If you do not have a registered Connection Configuration, please go to Add Connection Configuration to create one. |
database | Yes | - | Specify the name of the database containing the data you wish to retrieve. |
collection | Yes | - | Specify the name of the Collection to which you wish to Data Destination. |
query | No | - | Specify a query to narrow down the data in the collection you wish to transfer. |
Column Setting | Yes | - | Enter columns. Select the attributes to be extracted from the JSON of each record. Selectable attributes are limited to those at the top level of the JSON. |
Incremental Data Transfer | Yes | invalid | Enable/disable the mode in which only incremental data from the previous transfer is transferred. When Incremental Data Transfer is enabled, it retains "how far" the data has been transferred at the time of transfer. Note that specifying the same columns here that were specified in the item query will overwrite the conditions of the item query. |
Columns to determine incremental data | No | - | This can be entered when Incremental Data Transfer is selected as the transfer method. The value of the column specified here is stored in the last transferred record for each transfer. For the second and subsequent transfers, only records for which the target column of incremental data is greater than or equal to the value at the time of the previous transfer are transferred. Specify the column name, e.g., if there is a unique and Auto Increment ID column. If you wish to specify multiple columns, enter them separated by commas. If not specified, the primary key is used. |
Last record transferred | No | - | This can be entered when Incremental Data Transfer is selected as the transfer method. Incremental Data Transfer transfers data that is newer than the value specified here. If unspecified, transfer is performed from the beginning. Do not change this value unless you want to re-transfer any Incremental Data Transfer. Duplicate data may occur. |
Was this article helpful?