Release Notes - November 2022
  • 07 Dec 2022
  • PDF

Release Notes - November 2022

  • PDF

Article summary

Note

This is a machine-translated version of the original Japanese article.
Please understand that some of the information contained on this page may be inaccurate.

Hello! We will bring you the release information for November 2022!


Notice

Suspend the use of HubSpot API keys as an authentication method

HubSpot API keys will no longer be used as an authentication method to access the HubSpot API after November 30, 2022.
From now on, please use OAuth 2.0 as the authentication method.
For more information, see Accessing HubSpot API Keys.

Data Catalog

Sidebar query editor width is now variable πŸŽ‰

  • You can now freely change the width of the Data Catalog sidebar and query editor.
    • By dragging the border and moving it left or right, you can change it to the width you want.
      image

      image

DBT Integration

Execution command "dbt run-operation" added, supports πŸŽ‰ macro invocation

  • Added support for the Run commanddbt run-operationthat corresponds to macro invocation.
    • dbt run-operationBy entering the macro name in the command argument, you can invoke the macro when the job runs.
      image

Forwarding settings

Forward to Box

Forwarding destination box has been newly added πŸŽ‰.

  • You can transfer files to Box by specifying the folder path.
    image

Forward to HubSpot

image

Expanded πŸŽ‰ object types

  • The target object types for transfer destinations have been expanded.
    The object types added this time are as follows.
    • company
    • deal
    • product
    • ticket
    • line_item
    • quote

INSERT added πŸŽ‰ to transfer mode

  • An append (INSERT) has been added to the transfer mode.

In transfer mode UPSERT, UPSERT key can πŸŽ‰ be specified.

  • You can now specify a UPSERT key for UPSERTin transfer mode.

Destination Snowflake

Easy πŸŽ‰ ingestion of semi-structured (JSON) data

  • JSON columns are now included as VARIANT(one of the semi-structured data types) by default.
    • Previously, json columns were populated with VARCHAR by default.
    • For more information about semi-structured data types in Snowflake, see Semi-structured Data Types.
When you want to import a json type column as a VARCHAR type

As before, if you want to import a json type column with a VARCHAR type,
In Edit Transfer Settings STEP2 - Output Options Column Settings, select as theVARCHAR data type.

Source/destination Google Drive

Supports πŸŽ‰ shared drive transfers

  • Forward from Google Drive now allows you to transfer files from shared drives.
  • Forward to Google Drive can now transfer to a folder on a shared drive.

Transfer from TikTok Ads

Expanded πŸŽ‰ dimensions to be retrieved

  • The dimensions that can be retrieved have been expanded. The dimensions newly acquired this time are as follows.
    • Basic data metrics
      • reach
      • frequency
      • result
    • Video play metrics
      • video_watched_2s
      • video_watched_6s
      • average_video_play
    • Page Event Metrics
      • web_event_add_to_cart
      • on_web_order
      • initiate_checkout
      • add_billing
      • page_event_search

Forwarding/forwarding fromGoogle BigQuery

Expanded πŸŽ‰ dataset locations

  • Following GCP's region, the following three can now be selected in trocco.
    • Europe-West8 (Milan)
    • Europe-West9 (Paris)
    • Europe-Southwest1 (Madrid)
Environmentally friendly Google Cloud regions

Paris Madrid is a region with low carbon emissions.
For more information about carbon emissions in Google Cloud regions, see Carbon free energy for Google Cloud regions.

Connection Information

MongoDB

You can now πŸŽ‰ select the nodes you want to import

  • You can now select the nodes (members) you want to read from MongoDB's replica set.
    • Previously, primary was loaded.
    • From now on, you can select from the following five items in "Import Settings" of MongoDB connection information.
      • primary
      • primaryPreferred
      • secondary
      • secondaryPreferred
      • nearest
    • For more information, see About Read Preference.

Workflow Definition

Supports πŸŽ‰ looping workflows

  • Child workflows embedded in a workflow can now be looped.
    • You can add a workflow as a task on the flow edit screen and set up loop execution by editing the task.

image

image

UI/UX

In the forwarding setting list, support πŸŽ‰ for batch addition of schedules

  • In the forwarding settings list, you can now add schedules to the selected transfer settings in bulk.
    • You can add schedules in bulk by following these steps:
      image

API Updates

Yahoo! JAPAN Ads

The API version has been updated from v8 to v9.
For more information about the new version, please refer to the API Reference.

Twitter Ads

  • The API version has been updated from v11 to v12.
  • For more information about the new version, see the Twitter Developers documentation.

Facebook offline conversions

  • The Facebook API used for forwarding Facebook offline conversions has been updated from v14 to v15.
  • See the Meta for Developers documentation for the new version.

In addition, the following renovations have been added.

  • Datamarts - Snowflake

    • The name of the destination database can now contain a hyphen (-).
    • In the destination database when the data transfer mode is selected in the query execution mode, you can specify a database with a hyphen in the name.
      image
  • Team Features - Resource Group Details

    • In the Connection Information List tab, the service name of the connection information is now displayed in the form linked to each connection information.
      image

That's all for this release.
If you have any releases that interest you, please feel free to contact our Customer Success Representative.
Happy Data Engineering!


Was this article helpful?