Data Source - MongoDB
    • PDF

    Data Source - MongoDB

    • PDF

    Article summary

    summary

    Help page for ETL Configuration from MongoDB.

    constraints

    none in particular

    Setting items

    STEP1 Basic settings

    (data) itemindispensabledefault valueContents
    MongoDB Connection ConfigurationYes-Select the previously registered Connection Configuration that has the necessary permissions for this ETL Configuration.
    If you do not have a registered Connection Configuration, please go to Add Connection Configuration to create one.
    databaseYes-Specify the name of the database containing the data you wish to retrieve.
    collectionYes-Specify the name of the Collection to which you wish to Data Destination.
    queryNo-Specify a query to narrow down the data in the collection you wish to transfer.
    Column SettingYes-Enter columns. Select the attributes to be extracted from the JSON of each record.
    Selectable attributes are limited to those at the top level of the JSON.
    Incremental Data TransferYesinvalidEnable/disable the mode in which only incremental data from the previous transfer is transferred.
    When Incremental Data Transfer is enabled, it retains "how far" the data has been transferred at the time of transfer.
    Note that specifying the same columns here that were specified in the item query will overwrite the conditions of the item query.
    Columns to determine incremental dataNo-This can be entered when Incremental Data Transfer is selected as the transfer method.
    The value of the column specified here is stored in the last transferred record for each transfer.
    For the second and subsequent transfers, only records for which the target column of incremental data is greater than or equal to the value at the time of the previous transfer are transferred.
    Specify the column name, e.g., if there is a unique and Auto Increment ID column.
    If you wish to specify multiple columns, enter them separated by commas.
    If not specified, the primary key is used.
    Last record transferredNo-This can be entered when Incremental Data Transfer is selected as the transfer method.
    Incremental Data Transfer transfers data that is newer than the value specified here.
    If unspecified, transfer is performed from the beginning.
    Do not change this value unless you want to re-transfer any Incremental Data Transfer.
    Duplicate data may occur.

    Was this article helpful?