Release Notes - Mar 2022

Hello! Release information for March 2022!

Data Catalog

Significantly improved handling of query editors

Column completion to be displayed.

Column completions that were not previously displayed are now displayed.

Metadata is now displayed together with the completion display.

Metadata such as Salesforce Japanese column names automatically retrieved by the Data Catalog function are now displayed along with the completion display.
Please use this information to help you choose which columns to use when writing queries.
Future improvements will include the ability to display metadata defined by customers themselves and the ability to select which metadata to display.

More details are displayed when completing a function

The function completion display now shows the function details and a link to the BigQuery documentation.

Improved editor color scheme

Previously, the coloring did not correctly recognize BigQuery syntax, but this has been improved as shown in the reference image below.

Other improvements have been made to the completion display logic and to make it easier to use.

Support for displaying metadata in kintone

Data Catalog functionality can now reference kintone metadata.
If you have created an ETL Configuration that specifies kintone as Data Source and Google BigQuery as Data Destination, the "Metadata about kintone" field will appear in the Table Information and Column Information.

Sharding tables under any dataset to be displayed together

Sharding tables used to be displayed separately by date, but we have improved the display so that identical sharding tables are displayed together.

By default, information from the most recent table is displayed, but you can switch the date from the select box next to the table name.

*As of 2022/03/31, sharding tables are collectively displayed only when the display type is "Table Display".
　Please note that when the display type is "ER Diagram Display", the data is displayed by date as before.

Connection Configuration

OAuth2.0 can be selected as an authentication method in HubSpot Connection Configuration.

OAuth2.0 can now be selected as the authentication method in HubSpot's Connection Configuration.

Supports SSH connection in Oracle Database Connection Configuration.

Oracle's Connection Configuration now supports SSH connections, allowing for a wider range of connections.
Both password authentication and public key authentication can be used.

Please see the help page for details on how to set up the system.

ETL Configuration

Pipeline", "Pipeline Stage", and "Person in Charge" can now be retrieved at Data Source HubSpot.

Pipeline", "Pipeline Stage", and "Person in Charge" have been added as available targets for Data Source HubSpot.
By linking the pipeline managed on HubSpot with the data of the stage information of each pipeline, it is possible to visualize the status of DEAL and TICKET in more detail.
In addition, by linking the information of the person in charge with other HubSpot data, it is possible to analyze and visualize the movement of the person in charge on HubSpot.

Please see the help page for details on how to set up the system.

Deleted and archived records can be retrieved in Data Source Salesforce.

Data Source Salesforce now has an option to "Extract Deleted and Archived Records".
It allows for the extraction of archived records such as deleted records and task objects.

Please see the help page for details on how to set up the system.

Data Destination kintone adds "update" and "upsert" to transfer mode.

Data Destination kintone now has "update" and "upsert" transfer modes.
Until now, it was only possible to submit data to kintone, but by having this Data Setting, it will be possible to update data in kintone.

Please see the help page for details on how to set up the system.

datamart

Improved error message in Snowflake when Connection Configuration is incorrectly specified.

Error message display has been improved, making it easier for users to identify the cause.

UI・UX

FTP" listed as a data source is changed to "FTP/FTPS" and "HTTP" is changed to "HTTP(S)".

FTPS had been available on Data Source FTP, but it was difficult to understand in the UI, so we have changed it.
For the same reason, the Data Source HTTP has been changed to include HTTPS.
The function itself remains unchanged.

In addition, the following modifications and others have been added

• Data Source RTB House can now obtain the items "subCampaignId" and "subCampaignName".
• In Data Destination Spreadsheet, "truncate_insert" is added to the Transfer Mode.

**The contents of this release are described above. **
**Please feel free to contact our Customer Success Representative if you have a release you are interested in. **
Happy Data Engineering!