Contents x
    Release Notes - November 2022
    • 17 Jul 2024
    • Print
    • PDF
    Contents

    Release Notes - November 2022

    • Updated on 17 Jul 2024
    • Print
    • PDF
    Article summary

    Hello! Release information for November 2022!

    notice

    Stop using HubSpot API key as authentication method

    HubSpot API keys will no longer be available as an authentication method to access the HubSpot API after November 30, 2022.
    Please use OAuth 2.0 as your authentication method in the future.
    For more information, see Accessing HubSpot API Keys.

    data catalog

    Variable width of sidebar query editor 🎉.

    • The width of the sidebar and query editor in the data catalog can now be freely changed.

      • By dragging the border to the left or right, you can change the width as you wish.
        image

        image

    dbt linkage

    dbt run-operation" execution command added, macro call support 🎉.

    • The execution command dbt run-operation is now supported for macro calls.
      • Macros can be invoked during job execution by entering the macro name as an argument to the dbt run-operation command.
        image

    Transfer Settings

    Destination Box

    New destination box added 🎉.

    • You can transfer files to Box by specifying the path of the folder.
      image

    Forwarding HubSpot

    image

    Object types expanded 🎉.

    • Object types eligible for transfer destination have been expanded.
      The object types that have been added are as follows
      • company
      • deal
      • product
      • ticket
      • line_item
      • quote

    INSERT added to transfer mode 🎉.

    • An append (INSERT) has been added to the transfer mode.

    UPSERT key can be specified in transfer mode UPSERT 🎉.

    Forwarding Destination Snowflake

    Easy to import semi-structured (json type) data 🎉.

    • Columns of type json are now included by default as VARIANT (one of the semi-structured data types).
      • Until now, columns of type json were imported by default as VARCHAR.
      • For more information on Snowflake's semi-structured data types, see Semi-structured Data Types.
    To import a json type column as a VARCHAR type

    As before, if you want to import a column of type json as type VARCHAR,
    Select VARCHARas the data type in the column settings of STEP 2, Output Options, in the Transfer Settings Editor.

    Source and Destination Google Drive

    Support for shared drive transfers 🎉.

    • You can now transfer files on a shared drive in the source Google Drive.
    • In the destination Google Drive, you can now transfer to a folder on the shared drive.

    Transferred from TikTok Ads

    Dimensions of acquisition targets expanded 🎉.

    • The number of dimensions that can be obtained has been expanded. The newly acquired dimensions are as follows.
      • Basic data metrics
        • reach
        • frequency
        • result
      • Video play metrics
        • video_watched_2s
        • video_watched_6s
        • average_video_play
      • Page Event Metrics
        • web_event_add_to_cart
        • on_web_order
        • initiate_checkout
        • add_billing
        • page_event_search

    Destination and source Google BigQuery

    Expanded data set locations 🎉.

    • Following the GCP region, TROCCO now has the following three options.
      • europe-west8 (Milan)
      • europe-west9 (Paris)
      • europe-southwest1 (Madrid)
    Environmentally Conscious Google Cloud Regions

    Paris-Madrid is a low carbon emission region.
    For more information on the carbon emissions of Google Cloud regions, see Carbon free energy for Google Cloud regions.

    connection information

    MongoDB

    Enables selection of nodes to be loaded 🎉.

    • You can now select the node (member) you want to read from the MongoDB replica set.
      • Previously, the PRIMARY was loaded.
      • From now on, you can select from the following five items in the "Read Settings" of the MongoDB connection information.
        • primary
        • primaryPreferred
        • secondary
        • secondaryPreferred
        • nearest
      • For more information, see About Read Preferences.

    Workflow Definition

    Supports loop execution of workflow 🎉.

    • Child workflows embedded in a workflow can now be looped.
      • Loop execution can be set up by adding a workflow as a task on the flow edit screen and then editing the task.

    image

    image

    UI/UX

    Support for batch addition of schedules in the forwarding settings list 🎉.

    • Schedules can now be added to selected transfer settings in a batch in the Transfer Settings List.
      • You can add schedules in batches by following the steps below.
        image

    API Update

    Advertise on Yahoo!

    API version has been updated from v8****to v9.
    For more information about the new version, please refer to the API Reference.

    Twitter Ads

    • API version has been updated from v11 to v12.
    • For more information about the new version, please refer to the Twitter Developers documentation.

    Facebook Offline Conversion

    • Forwarded to Facebook The Facebook API used for offline conversions has been updated from v14 to v15.
    • Please refer to the Meta for Developers documentation for the new version.

    In addition, the following modifications and others have been added
    * Data Mart - Snowflake
    * The name of the destination database can now include a hyphen (-).
    * In the destination database when data transfer mode is selected in query execution mode, you can specify a database whose name contains hyphens.
    image

    • Team Functions - Resource Group Details
      • In the Connection Information List tab, the service name of connection information is now displayed in the form associated with each connection information.
        image

    **The contents of this release are described above. **
    **Please feel free to contact our Customer Success Representative if you have a release you are interested in. **
    Happy Data Engineering!

    Was this article helpful?
    What's Next