LDW 2.3.18 released: BigQuery improvements, Studio improvements, LDAP encryption

One focus area in version 2.3.18 was improving reading data from BigQuery. We fixed issues with many date/time, string and numeric functions which were partially not pushed down or produced error messages. There are more BigQuery improvements for additional functions planned for the next minor release.

Many details were also improved in the DV Studio, e.g. there is now a dedicated button for the JSON query builder and the XML query wizard automatically detects the right encoding based on the XML prolog.

If you are using LDAP authentication, there is now the option to encrypt the credentials for connecting to the LDAP repository in Data Virtuality's configuration file, so they are not stored in plaintext any more on the file system. Please see the documentation for more details.

DV Web

• DVCORE-7121: Add double quotes to fields in CSV export

Studio

• DVCORE-7161 (Improvement): Rename MemSQL to SingleStore
• DVCORE-7131 (Improvement): Improve Snowflake wizard for Azure Blob Storage Load
• DVCORE-7125 (Improvement): Update Snowflake Wizard help section
• DVCORE-5903: The "Schema" field is not mandatory in Snowflake Analytical Storage wizard
• DVCORE-6780 (Improvement): Add a reminder to configure uploadMode in Snowflake and Redshift wizards
• DVCORE-7008 (Improvement): Add a job script preview in the properties section of the job list
• DVCORE-6982 (Improvement): The job history tab should display job descriptions
• DVCORE-6206 (Improvement): Create a dedicated button for calling the JSON query builder
• DVCORE-6195 (Improvement): Improve the XML import wizard by using encoding from XML prolog if it is present
• DVCORE-5244 (Improvement): Long descriptions for procedures and views cannot be read and have wrong tooltips
• DVCORE-7122: The SYSADMIN.importView procedure is used for copying/moving procedures on schema creation
• DVCORE-7092: Opening of 'Edit data source' wizard for LDAP data source fails

Connectors

• SQL-308 (New Feature) Unleashed connector: Create the Unleashed connector
• SQL-320 (Improvement) Stripe connector: Add procedure to list payment intents
• SQL-311 (Improvement) Google Analytics: Make DELETE behavior transactional
• SQL-202 (Improvement) Adobe Analytics 1.4: Add "parentId" as a returned property
• SQL-16 (Improvement) Criteo connector: Update column data types
• SQL-13 (Improvement) Recurly connector: Adjust subscriptions procedures for better data consistency
• SQL-313 Apple Search Ads: Campaigns Report procedure delivers appName and adamId fields squashed together
• SQL-292 Shopify connector: Deleting from non-existent subtables fails
• SQL-285 Criteo connector: 504 error in the StatisticsCampaignPerformance procedure and incorrect processing of 401 error in loops inside doQuery
• SQL-130 Hubspot connector: HTTP status code 429 is not correctly handled
• DVCORE-6404 Salesforce: It is impossible to configure a proxy URL
• DVCORE-7139 Salesforce: Getting BOOLEAN value from a column having Salesforce anyType field type results in an error
• DVCORE-7152 Salesforce: NOT IN used with a list of literals is incorrectly pushed down and behaves as IN
• DVCORE-7150 Snowflake: Keep-alive queries are disabled by default
• DVCORE-7143 Oracle ADWC is not recognized as a possible Analytical Storage
• DVCORE-7142 Oracle ADWC: 'wallet' property is missing in the Oracle ADWC CLI template
• DVCORE-7162 BigQuery: Several string and numeric functions fail or are not pushed down
• DVCORE-6270 BigQuery: Several date and time functions fail and are not pushed down
• DVCORE-6859 Hive: Only tables in the default database are loaded
• DVCORE-6781 Oracle: Non-system schema matching the importer.schemaPattern is not imported on data source creation if its name is a substring of some system schema name
• DVCORE-7069 Azure Synapse Analytics: UPSERT is very slow on large data sets

Backend

• DVCORE-7130 (Improvement): LDAP authentication: Allow encrypting credentials
• DVCORE-7064 (Improvement): Data Virtuality Exporter: Unify naming of the files generated by the exporter
• DVCORE-7015 (Improvement): Improve handling of string and numeric data types for all data sources
• DVCORE-6954 (Improvement): Add an error message for simple structure differences between views and materialized tables corresponding to them
• DVCORE-7172 Performance monitoring: NullPointerException is thrown sporadically on requesting engine-statistics data
• DVCORE-7149 LEFT JOIN produces incorrect result when combined with WHERE and is not pushed down to the source
• DVCORE-6929 Data Virtuality Server shutdown may fail on Windows Server due to incorrect handling of whitespaces in jboss-cli.bat