version: 8.0.1
module: https://talend.poolparty.biz/coretaxonomy/42
product: https://talend.poolparty.biz/coretaxonomy/183
R2022-04
Info |
Value |
Patch name |
Patch_20220422_R2022-04_v1-8.0.1 |
Release date |
2022-04-22 |
Target version |
20211109_1610-8.0.1 |
Product affected |
Talend Studio |
Introduction
This monthly release includes all previous generally available patches for Talend Studio 8.0.1.
For more information about the new features and bug fixes included in this monthly release, see:
Prerequisites
Consider the following requirements for your system:
- Talend Studio 8.0.1 must be installed.
Installation
Before applying an update to Talend Studio, check:
Note:
A number of jars have been upgraded in this update patch. To avoid confusion, after installing this patch you can delete the CVE impacted versions from your local studio directory and artifact repository. For example, for an old log4j jar:
remove <studio>/configuration/.m2/repository/org/apache/logging/log4j/log4j-core/<version>/log4j-core-<version>.jar
remove the jar from your artifact repository:
Where <studio> is your studio installation folder and <version> is the CVE impacted version. For the upgrade information and the specific impacted versions, see the "Fixed issues" and "Security CVEs" parts of this documentation.
Installing the patch via setting up the Update URL in Talend Studio (recommended)
If your Talend Studio supports installing features using the Feature Manager wizard, it can detect and notify you about available patches and install the patches automatically when the Update URL is correctly set up in Talend Studio.
For more information about the Feature Manager wizard, see Managing features in Talend Studio.
For more information about setting up the Update URL, see Setting up the Update URL of Talend Studio.
Installing the patch using Software update in Talend Administration Center (for on-premises users)
- Log in to Talend Administration Center and go to Settings->Configuration->Software Update. Enter the correct values and save them referring to the documentation Configuring the Software Update repository in Talend Administration Center.
- Download the patch from the Settings->Software Update page into the nexus repository.
- Log in to Talend Studio in the remote mode.
- If your Studio supports installing features using the Feature Manager wizard, go to the wizard to proceed with the patch installation. Otherwise, click the Update button displayed on the login window to install the patch.
Installing the patch using Continuous Integration
To install the patch using Talend CI builder, use the -Dtalend.studio.p2.update
option at build time.
NOTE: Use Talend CI Builder version 8.0.4 in your CI commands or pipeline scripts for this Studio monthly update.
For more information, see Building and Deploying.
Installing the patch manually using Talend Studio
- Download the patch from the repository for Talend updates manually.
- Create a folder named "patches" in your Studio installation directory and copy the patch .zip file to this folder.
- Restart your Studio.
- If your Studio supports installing features using the Feature Manager wizard, log in to your project and go to the wizard to proceed with the patch installation. Otherwise, click OK when prompted to install the patch.
New features in R2022-04
- TUP-34516 - CI - ZeroInstall: Refactor CI builder to prepare for publish it to public repository
- TUP-33038 - [CI] Improve the P2 installation process
- TUP-32273 - CI: when installation is present and license expired CI should update the license based on -Dlicense.path
- TUP-31734 - Prompt users to Test patches when migrating projects
- TUP-34849 - Support retrieve SAP ADSOs metadata for provisioning
- TUP-35069 - Upgrade Redshift driver to v2.x
- TDI-47211 - Upgrade Libraries for Ms-SQL Server - Support for MSSQL Database 2019
- TDI-45052 - connect SAP BW4/Hana (tSAPADSOOutput)
- TDI-43313 - Dynamic suppport for tSAPTableInput
- TDI-47565 - Add List, Delete, Properties to SMB components v2/3
- TDI-46111 - [7.1] Security vulnerabilities with Teradata 16 drivers
- TDI-47263 - Upgrade Redshift driver to v2.x
- TUP-34896 - support teradata jdbc version 17
- TUP-34929 - Upgrade Libraries for Ms-SQL Server - Support for MSSQL Database 2019
- TDQ-20141 - Data privacy components: Security enhanced for masking data using PBKDF2 with 300,000 iterations
- TBD-13105 - Support using multiple tGSConfiguration in spark jobs
- TBD-13185 - Make the universal spark 3.2.x plugin able to run spark local jobs
- TBD-13328 - Tech preview - Azure AD Service Principal for Azure Synapse Spark pools configuration in Spark job
- TBD-13391 - GA - Spark Universal 3.1.x for AWS EMR 6.3.x / 6.4.x / 6.5.x
- TBD-13504 - Smoke test - CDP Public Cloud + KNOX + Impala
- TBD-13517 - Tech preview - Support Open Source Apache Spark Standalone cluster with Spark 3.2.x
- TBD-13522 - GA Cloudera CDE on AWS
- TBD-13632 - GA - Universal Spark 3.1.x for Google Dataproc 2.0.x and above
- TBD-13685 - GA - Universal Distribution with Spark serverless 3.1.x - Databricks Transient cluster
Fixed issues in R2022-04
- TUP-34337 - [CI] Enable timeout settings when fetching files from P2 repository
- TUP-35133 - Run a job with subjob failed after applied a patch with new version of CI-Builder
- TUP-34716 - can't get the right "ACTIVEDATABASEDELIMITED_IDENTIFIERS" property value in tELTMap in javajet
- TUP-35238 - Drag and drop Redshift metadata to list components lost some components
- TUP-34930 - Talend Studio 7.3 font color issues
- TUP-34645 - Send username and password via http request body
- TDI-47428 - Job is OK and no relevant error or warning on component when Table name is not defined in tDBOutput (JDBC)
- TDI-47452 - Error when generating a job with tXmlMap , if a field contains some special characters
- TDI-47073 - tBigQueryOutput component needs right description
- TDI-47287 - throws null pointer exception when no existing file
- TDI-47608 - [TCK][Tableau] Since the "Data source name" field is mandatory, we should keep it display at the beginning
- TDI-47651 - Redshiftoutput component takes more time to insert
- TDI-47560 - tSybaseOutput error if the input data is in the BigDecimal Type with Length and Precision definition
- TDI-47641 - Issue Pulling data from NetSuite CreditMemo and Invoice Record Type
- TDI-47670 - tFileInputXML: result of XPath "count" depends on XML formatting
- TDI-47725 - tDBOutput returns counter NB_LINE = 0
- TDI-47539 - Microsoft CRM: change application secret as a password field
- TDI-47538 - tAzureAdlsGen2Output component converts BigDecimal to String
- TDI-47649 - ngdbc.jar shouldn't be required when tSAPADSOInput uses connection type 'SAP JCO3'
- TDI-47687 - tSCP component reuse session
- TDI-47404 - Upgrade CXF-3.3.X to 3.4.4
- TDI-47589 - "Write Excel 2007 format" leads to tFileOutputExcel poor performance
- TDI-47201 - Studio not connecting via proxy when snowflake connection uses oauth
- TDI-47496 - Column names in a main query are not enclosed when enabling "Delimited identifiers"
- TDI-46584 - tServiceNowInput Limit disable option in Advanced settings not working
- TUP-27413 - SQL Builder: Graphical Editor is Empty for a specific table
- TUP-34378 - Job could build out successfully if contains component which cannot be loaded
- TUP-34994 - Retrieve schema pop up error for my imported mongoDB
- TUP-35034 - CI - stop the build if custom component is missing
- TUP-34989 - DetectCVE: Some indexes are missing in cveindex.csv
- TUP-34822 - [bug] Forward slash in path of -DcveIndexFilePath and -DcveReportFilePath cannot be recognized correctly
- TUP-35180 - [CI] detectCVE can't use relative paths
- TUP-34987 - Identify Jobs having CVEs remediated improvement.
- TUP-35020 - Unable to ask for the feature manager to install the plugin for the new TCK connectors
- TUP-35191 - Receiving error popup: netsuite can't be deployed when the feature is installed
- TDQ-20255 - Microsoft SQL Server: Libraries upgraded
- TDQ-19622 - Analysis from Hive connection: Fixed the issue causing the tables to be displayed twice in the Column selector wizard
- TDQ-20110 - tDqReportRun: Fixed the issue causing some jars to be installed
- TDQ-20185 - tPatternMasking: Fixed the issue causing the NoClassDefFoundError
- TDQ-20222 - Reports: Fixed the issue preventing from running a report on a Cloud or Remote Engine
- TDQ-19997 - Git project: Fixed the issue causing the NullPointerException error when editing the file connection
- TDQ-20209 - (Un)Masking components, Apache Spark Streaming: Fixed the issue preventing from unmasking data to initial data when the tweak is invalid
- TDQ-19768 - tDqReportRun: Fixed the issue causing the Job to fail when using a match analysis with the Custom Matcher
- TDQ-20234 - tDqReportRun: Fixed the duplicate records issue for snowflake as datamart when parallelize running
- TDM-9394 - [tHMap]Deactivated output connection loses its metadata table
- TDM-9285 - [tHMap]Using a tUnite as an output connection causes an NPE during code generation
- TDM-9334 - With Flat representation Decimal property is not working as expected
- TDM-9278 - [OldRuntime]Execution status is accumulated when there are multiple executions for a tHMap
- TDM-9359 - Get npe when click thmaprecord/thmapinput which used in joblet
- TBD-12119 - Inherit credentials option in tS3Configuration should be hidden for all distributions except EMR and Databricks (AWS)
- TBD-13500 - Spark tFileInputDelimited ExtractDelimited_Function.call NumberFormatException
- TBD-13587 - CDP Private Cloud/Public Cloud: Add zookeeper libraries to HiveServer2 HA components for standard components
- TBD-13619 - Job fails with error java.lang.IllegalArgumentException: Field "WGTCHARGEABLE" does not exist with Patch R2022-02v1-7.3.1
- TBD-13645 - [Talend 8.0.1] Hbase component has compiler error in spark job
- TBD-13681 - Authentication with IDBroker failed when running spark job with S3 on CDP PC AWS
- TBD-13701 - Fail to generate code when job uses tMap with advanced expressions
- TBD-13730 - Compile error on tHDFSConnection on DI job with ERM62 cluster
- TBD-13737 - The thdfsconnection doesnt include Hadoop-Auth jar in the build for CDP 7.1.1 inbuilt distribution
- TBD-13739 - [8.0.1-R2022-03] Code is not generated for Spark Big Data Jobs with component tCassandraOutput
- TBD-13740 - [7.3.1-TPS-5153] TalendDate.getPartOfDate function fails with error Syntax error on token "YEAR", invalid AssignmentOperator
- APPINT-34485 - No task created when publishing a SOAP Service to Cloud from Studio 8
- APPINT-33991 - [Ubuntu20] API definition mapping could not be shown in cREST in Ubuntu20
- APPINT-34277 - Cannot create two AMQP Connections in same route
- APPINT-34296 - Error show in error log when publish a new created job not committed and pushed
- APPINT-33830 - Wrong statement displayed for tRESTClient timeout parameters
- APPINT-34414 - Build Route as MS ZIP will package useless joblet/code folders in ZIP root
- APPINT-34443 - Jar mismatch issue when using trest and tresclient in Talend Runtime
- APPINT-34398 - Failed to build route as Microservice when enable Prometheus
- APPINT-34491 - Missing jar when running SOAP service in Studio
- APPINT-34517 - Limit microservices available endpoints to info, health and jolokia
- APPINT-34547 - Failed to run route with cMQConnection (AMQP)
Security CVEs fixed
CVE-2021-35517 (commons-compress-1.19.jar), impacted:
metadata bridge
CVE-2022-23437 (xercesImpl-2.12.0.jar), impacted:
DI Components
CVE-2021-33813 (jdom2-2.0.6.jar), impacted:
DI Components
CVE-2021-30129 (sshd-core-2.7.0.jar), impacted:
DI Components
CVE-2021-22569 (protobuf-java-2.5.0.jar,protobuf-java-3.4.0.jar), impacted:
DQ Components
Studio
CVE-2019-4055 (com.ibm.mq.allclient-8.0.0.9.jar), impacted:
DI Components
CVE-2020-36518 (jackson-core-2.11.4/2.12.0.jar,jackson-databind-2.11.4/2.12.0.jar), impacted:
Build
APPINT Components
CVE-2021-38153 (kafka-clients-2.8.0.jar), impacted:
APPINT Components
CVE-2021-22096 (spring-core-5.3.8.jar), impacted:
APPINT Components
CVE-2022-23305 CVE-2022-23302 CVE-2021-4104 CVE-2019-17571 (log4j1.x), impacted:
DI Components
DQ Components
BD Compoents
Studio
CVE-2017-5929 (logback-core-1.0.9.jar,logback-classic-1.0.9.jar), impacted:
DI Components
CVE-2021-30468 (cxf-3.3.x), impacted:
DI Components
Studio
SourceClear Premium(No CVE) (org.ops4j.pax.url.mvn_2.6.2.Talend.jar), impacted:
Studio
Fixed issues in R2022-03v2
- APPINT-34517 - Limit microservices available endpoints to info, health and jolokia
Security CVEs fixed
New features in R2022-03
- TUP-33406 - Identify Jobs having CVEs remediated
- TUP-34545 - [CICD] builder-maven-plugin:7.3.4:generateAllPoms seems to not take in account Project filter
- TUP-33990 - Pendo tracking for Studio integrations with API Designer & API Tester
- TUP-33202 - Use new mapping for Cassandra driver version 4 in metadata.
- TDI-46441 - Upgrade Cassandra driver to latest (4.12) to support latest version of Cassandra
- TDI-47154 - send exception info for audit log
- TDI-47136 - Upgrade snowflake JDBC driver 3.13.14
- TBD-12969 - Tech preview - Cloudera CDE experience on AWS with the Universal Distribution (Data Engineer)
- TBD-12854 - Support for AWS EMR 6.3.x / 6.4.x and 6.5.x with Universal Spark 3.1.x as technical preview (yarn distrib)
- TBD-13256 - Tech Preview Spark Universal 3.1 for Databricks transient cluster only
- TBD-13468 - GA - CDP Public Cloud DataHub with Knox
- TDM-8112 - JSON Schema to support on creating structures
- TDM-9033 - Add representation options to reduce size of JSON output
- TDQ-20069 - tDataQualityRules: Improved the component
- TDQ-19889 - Analyses and reports: Enabled the prompt to use context variables from Profiling perspective
- TDQ-20094 - tDataMasking/tPatternMasking: New option Use a column containing the tweaks to use an input column to provide the tweaks
Fixed issues in R2022-03
- TDI-47385 - tMap error when tenary operator is used in join condition of column with Date type
- TDI-47436 - tPostgreSqlOutput doesn't support dynamic column with upsert
- TDI-47437 - tPostgreSqlOutput can't support additional columns column with upsert
- TDI-47435 - tPostgreSqlOutput compile errors when 'Debug query mode' and 'Upsert'
- TDI-47440 - Cannot connect to Salesforce with password starting with double-quotes
- TDI-47477 - Issue with tExtractPositionalFields in 7.3.1 version
- TDI-46768 - [TCK][Studio] Unable to run ADLSGen2 in the ESB runtime (OSGI Mode) with 731 R2021-09
- TDI-47524 - tPostgreSqlOutput can't work when columns include dynamic and replace one non-dynamic column
- TDI-47401 - MSSQL database getting data as "True" and "false" instead of "0" and "1"
- TDI-47493 - tSAPInfoObjectOutput can't handle medium and long texts
- TDI-47230 - OOM caused by org.talend.transform.runtime.lib.MapExecutorImpl From tHmap
- TDI-46642 - Observability: connector_label is not correct
- TDI-46789 - tMSSqlOutputBulkExec cannot work with server on Linux platform, where as tMSSqlBulkExec can
- TUP-35003 - DetectCVE: One not fixed item always show in report
- TUP-34791 - Add project reference to Project Login Pendo tracking
- TUP-28898 - Drag Exasol connection to a job choose tDBOutput(Exasol) not work as tExasolOutput
- TUP-34652 - Sybase CDC query that is generated groups by all columns
- TUP-34769 - Error fields for Rejects get dropped from tSalesforceOutput after Sync Columns
- TUP-34593 - Cannot connect to Salesforce with password starting with double-quotes
- TUP-34609 - Cannot retrieve Module Name in tSalesforceInput with password starting with double-quotes
- TUP-34427 - Resource:"The system cannot find the path specified" error shows if build job first then run job and job calls child job which using resource
- TUP-33120 - Button appears cropped in License Window
- TUP-32950 - On Ubuntu 18.04.5 documentation comment is displayed as a black box in Talend Studio designer tab
- TUP-30599 - tMap drag and drop does not work seamlessly in Linux GUI as it does in Windows
- TUP-33381 - Remove all the logs related to other OS
- TBD-13437 - "Inherit credentials from AWS" option in tS3Configuration component for S3 authentication not working
- TBD-13493 - Hive connection failed in Talend 8 with CDH 7.1.6
- TBD-13649 - Error shows after trying to open a specific spark job
- TBD-13657 - Dataset<DS_out_53AvroRecord> is not applicable for the arguments
- APPINT-33070 - tRestClient Accept Multipart results in row1 code generation error
- APPINT-34318 - Deployment in Runtime fails with - "javax.xml.transform.stream.StreamSource@541b668d'. Use a StreamSource or ObjectSource"
- APPINT-33481 - Cannot auto create component: jetty when execute microservice jar of chttp
- APPINT-33781 - Build KAR and browse with sub-directory having same name as route
- APPINT-33965 - Replacement of ScriptEngine nashorn for safer alternative
- APPINT-34310 - Unexpected "lib" folder at root of ZIP microservices builds
- APPINT-34330 - Not able to publish a DI job through CICD when it contains tRestClient
- APPINT-34332 - Redirection to wrong preference page using link in API creation wizard
- TDM-9308 - Improve blacklist mechanism for JSON Schema import
- TDM-9302 - Performance Issues with Talend Jobs after applying Talend Studio Patch R2021_12, suspecting tHMap
- TDM-9263 - Mapping builds fine in Studio, but fails within CI
- TDM-9261 - run DI job return NPE error
- TDM-9257 - XQuery code generation fails with NPE when function is incomplete
- TDM-9255 - [tHMap]Regression: Map creation wizard shows an error when no input is connected
- TDM-9254 - JSON default alternative matcher should accept integer as exact match for Double/Float
- TDM-9224 - Infinite Loop in AvroSchemaUpdater
- TDM-9215 - Fix numeric enumeration in avro export/import completely
- TDM-8954 - Cobol level 88 exported as avro schema and imported again looses numericity
- TDQ-20053 - Simple Analysis: Fixed the error preventing from creating a Simple Analysis from a Parquet format file
- TDQ-20106 - Report: Fixed the error preventing from running a report from a Basic Column Analysis
- TDQ-19508 - tMatchGroup with T-Swoosh algorithm: Improved the interface to inform about Sort the output data by GID in Multi-passing mode
- TDQ-20184 - Job generated from report: Fixed the issue causing a Data Integration child Job containing tFileInputExcel to fail
Security CVEs fixed
CVE-2021-36373 (ant-1.10.9.jar), impacted:
DI Components
CVE-2012-5785 (axis2-kernel-1.8.0.jar), impacted:
DI Components
CVE-2021-22569 (protobuf-java-3.4.0.jar), impacted:
DI Components
CVE-2022-23221 (h2-2.0.206.jar), impacted:
Studio
CVE-2022-23437 (xercesImpl-2.12.0.jar), impacted:
Studio
CVE-2022-23305 (log4j-1.2.17.jar), impacted:
Build, Deploy job
CVE-2021-43859 (xstream-1.4.18.jar), impacted:
APPINT Components
DQ Libraries
Studio
CVE-2021-43797 (netty-codec-4.1.68.Final.jar), impacted:
APPINT Components
CVE-2021-22096 (spring-core-5.1.18.RELEASE.jar), impacted:
Studio
New features in R2022-02
- TDI-46964 - Google Drive: Correct way to guarantee that resource is created onsubjobok
- TDI-47199 - Couchbase v7 in Studio
- TDI-45863 - Capability to manage files using Samba v2 or higher
- TDI-41801 - Connector in Talend Studio to Read /write data from/to AWS DocumentDB
- TDI-40320 - Add Tableau components in Studio
- APPINT-26018 - Unify the cloud connection configuration between Studio Project Connection and Publish to Cloud/API bridge
- TBD-12989 - Spark 3.1.x universal launcher for Databricks 8.0 and above - Interactive cluster only
- TBD-12990 - Tech preview - Spark Universal 3.1.x for Google Dataproc 2.0.x
- TBD-13494 - Make the universal spark 3.1 plugin able to run spark local jobs
- TUP-34032 - Support connection string and X509 authentication method for MongoDB Metadata
- TUP-33432 - Improve feature manager top bar button for mac
Fixed issues in R2022-02
- TDI-47259 - tAzureAdlsGen2Output Date type for AVRO and Parquet caused log warn message in Input
- TDI-35717 - tOracleBulkExec's "action on table" was used when invisible
- TDI-47325 - Cannot create data source(SAP BW version 7.5)
- TDI-47395 - tPostgresqlOutput cannot select Insert as Action on Data when disable the Log4j
- TDI-47396 - tSCPGet doesn't always close session
- TDI-47484 - TDS job became slow when large retry number is used.
- TDI-47375 - tMicrosoftCRM components with compile error when using OnPremise 2011
- TDI-47193 - Talend Studio 8.0.1 compiling error with more than one tDataPrepRun
- TDI-46848 - Dynamics CRM ON-PREMISE with OAuth 2.0 authentication
- TUP-34390 - Wrong file selection dialog title for "Export custom settings" in Modules view
- TUP-33675 - Throw "Invalid key name: mdm.encryption.key" in error log when studio start up
- TUP-34660 - TOS: Cannot build job successfully
- TUP-34510 - Wrong dependency on TOS build
- TUP-34432 - No "Find features needed for the import" dialog shows when importing items which contains resource items
- TUP-34120 - Restart studio after install feature will have : "Workbench has not been created yet" in error log
- TUP-34156 - UI is broken for TCK Table structures in 8.0.1 + nighty
- TUP-34410 - Integrate Tableau Connector
- TUP-34575 - Correction to messages.properties file
- TUP-34383 - Studio not responding on 'publish to Cloud'
- TUP-33639 - Job which import by metedata bridge:NPE when check/uncheck "use project settings" in stats&logs
- TUP-34682 - Studio 8.0.1 R2022-01-can't access Support Exchange
- TUP-34574 - Feature Manager unexpectedly list duplicate category
- TUP-34401 - Detect Dependencies is not working
- TUP-34053 - Can't fetch correct Parquet file schema when using 'Create Simple Analysis'
- TUP-33321 - Small bottom right notif window "Welcome to Studio 8 ..." always in the foreground even switching to another application
- TUP-34433 - Plugins not always removed from studio after apply an update
- TUP-34663 - Integrate Amazon DocumentDB into Studio
- APPINT-34245 - RESTFUL Endpoint Job with tDBOutput is failing
- APPINT-34254 - ClassNotFoundException: org.talend.fileprocess.FileInputDelimited when Rest service calls tFileInput* inside joblet
- APPINT-31044 - Data service's endpoint can't be updated if passed as a context variable
- APPINT-32893 - API Designer - Issue with tRestRequest
- APPINT-33765 - ClassNotFoundException in runtime when DB connection (SQLServer) in joblet without using alias
- APPINT-34206 - Camel Property DSL Generation Compile Error
- APPINT-34319 - Property language not working in cSetProperty and cSetHeader
- APPINT-34329 - Add back support for separate logs in TMC for individual Data Services/Routes (Studio part)
- APPINT-34339 - Using json path in camel components leads to no class def found error
- APPINT-34316 - Compilation error with routes using cBean (Reference to another bean)
- TBD-10632 - AvroParquetOutputFormat issue with tSqoopImport on HDP31
- TBD-13204 - ClassNotFoundException: org.xerial.snappy.Snappy when tFileOutputParquet in streaming job on studio 8.0
- TBD-13285 - Talend Azure Synapse HDFS component issues
- TBD-13315 - Compile error when di job use tHDFSConnection
- TBD-13319 - Compile error when spark streaming job uses tTopBy with CDP7 built-in
- TBD-13374 - tImpalaConnection - Use Kerberos authentication checkbox does not work
- TBD-13441 - [QA] Check TUP-34053 Can't fetch correct Parquet file schema when using 'Create Simple Analysis'
- TBD-13463 - No FileSystem for scheme: HDFS on any EMR 5.29 job on Talend 8
- TBD-13498 - [7.3 ,R2022-01 ]UPPER case context variables getting converted to LOWER cases with thiveinput (Patch: R202201-log4j)
- TBD-13507 - Hard-coded value in hql is transformed to unexpected case in target parquet file
- TBD-13519 - Error "Syntax error on token "class", Identifier expected" after applying temp patch Patch20220113TBD-13323_v1-7.3.1
- TDQ-19421 - Semantic-aware analysis ->"Check Connection" in preference page will restore the data in elastic search server
- TDQ-19754 - Snowflake Datamart: improve the error message to give user a valuable reminder
- TDM-9219 - Not able to build a Talend Data Mapper job on 7.3.1 from Commandline.
- TDM-9227 - [7.3.1] Trim on value no more working in DataMapper field with fixed length in structure (Regression)
- TDM-7427 - data type optional segment is in test run result
- TDM-7904 - Json structure with invisible group can't parse data while highlight right
- TDM-9077 - Avro exporter produces wrong operand avroloc within Choices and Alternatives
- TDM-9119 - Check support for Distinct(using GroupBy) with Streaming
- TDM-9147 - Variable $var in TDM expressions gets exported as $$var
- TDM-9201 - Cobol Show Document error reporting must be improved
- TDM-9205 - [tHMap]Cleanup unused log level in the component xml file
- TDM-9213 - Enum numericity in exported avro schema is needed for most writers
- TDM-9214 - Default JSON Choice matcher should use Enum values when available
- TDM-9217 - Avro export of Structure inheriting from Choice element is missing recursive cases
- TDM-9222 - JSON Reader gets stackoverflow with recursive Choice
- TDM-9223 - Improve avro schema export performance for Show Document
- TDM-9226 - Null item in JSON array is omitted on output
- TDM-9237 - JSON Reader encodes ellipsis character
Security CVEs fixed
CVE-2020-25638 (maven-shared-utils:[0.4,0.1]), impacted:
Studio
CVE-2021-42392 (com.h2database:h2:1.4.198), impacted:
Studio
CVE-2012-5785 (axis2-kernel-1.7.8.jar), impacted:
metadata bridge
CVE-2012-0881 (xercesImpl:[2.11.0,2.11.0]), impacted:
metadata bridge
Fixed issues in R2022-01v2
TUP-34595 - Issue while logging into a Cloud Project using a proxy with R2022-01
New features in R2022-01
- TUP-33284 - Allow Publishing to cloud only if the job items are committed and pushed to Git
- TUP-32059 - Add git info in the jobinfo.properties when building job from CI
- TUP-33610 - Remove deprecated item in NoSQL connections.
- TDI-46470 - tKafkaOutput NB_LINES and other statistical after variables
- TDI-46430 - tKafka to handle Avro data in DI jobs
- TDI-46806 - Azure Blob Storage supporting the latest API version
- TDI-46460 - Integrate Apache Kudu / TCK in Studio
- TDI-47330 - Improved error logging for ODP and ADSO input
- TDI-46837 - tELTSAPMap: Improved logging for SAP components
- TDI-46093 - Add connection component for Tck ADLS gen2
- TDI-46875 - Implement $inc in MongoDBOutput in order to increment the value of existing field
- TDI-46698 - MongoDB add .skip / .batchSize options to input
- TDI-46627 - Upsert and push functionality in tmongodboutput component
- TDI-46665 - TCOMPv0 (Daikon) to support java 17 (runtime)
- TDI-46151 - Filter data based on return value in subquery in source database before pushing it down to a tDBInput to execute
- TDI-46093 - Add connection component for Tck ADLS gen2
- APPINT-34208 - Publish to cloud from CI: provide project/GIT informations in published artifact model
- APPINT-33784 - Project analysis task - Warn about custom component dependencies risk
- TBD-13144 - Upgrade kafka to 2.4.0
- TBD-13222 - Remove deprecated version for NoSQL in spark/spark stream components.
- TBD-13262 - HWC/Knox job is not able to connect to cluster
- TBD-13254 - Smoke test CDP Atlas
- TBD-13381 - Simplify drop-down naming for Cloudera CDP distribution
- TBD-13389 - Tech preview - CDP Public Cloud with Knox (official certification)
- TDQ-19814 - tDataQualityRules: New component to use DQ rules in the Studio
Fixed issues in R2022-01
- TUP-34111 - [7.3.1] slow studio build time for remote execution, compared to local exec, or build job with R2021-01 or higher
- TUP-33966 - Studio/commandline fails to generate code for the job, throws "Invalid thread access"
- TUP-33369 - Need restart Studio to show FeatureList after network is broken and fixed later
- TUP-33964 - Integrate Apache Kudu Connector
- TUP-33863 - Update of Metadata Hadoop Cluster does not change spark version when propagated
- TUP-34123 - 'talendcsv-1.0.0.jar' is missing on 'Guess Schema' operation
- TUP-33939 - Ubuntu: Cannot close "Quick Tour" after logon a migrated project with a new extracted Studio
- TUP-34312 - Remove the signer from CI builder
- TUP-33185 - [CI] Cannot read .project file
- TUP-33830 - [7.3] ref project compilation error
- TUP-33962 - Error in handling default value as NULL
- TUP-34095 - Feature Manager> what's new is not expected to be to editable
- TUP-34356 - Improve update wizard to expand the what's new scroll pane according to the size of the dialog
- TUP-34127 - Feature manager should popup error if update version is lower than studio version
- TUP-30975 - Can't move Couchbase connection to folder
- TUP-33897 - Remove username from Studio Cloud Login
- TUP-33644 - TMC: error pop up when uncheck "use manual commit mode" and check out as local branch
- TUP-33776 - "Enable Parallel execution" in tOracleInput and tRESTClient
- TUP-34274 - [8.0] missing tesbconsumner component in studio with data management license
- TUP-34405 - Feature ESBConsumer is not active after import in a 73 existing project.
- TUP-33883 - Commandline upgrade script can't load update url from studio configuration
- TUP-34440 - Missing some tcompv0 basic plugins updates in 8.0 patch
- TUP-33214 - Migrated 731 project could not show the build popup for job build operation and gives error(IllegalArgumentException: Comparison method violates its general contract!) in macOS
- TDI-46910 - [tELTMap] The way to escape Db Column in multi-byte character in is different between input and output
- TDI-44321 - Update misleading text on SSL connection in tMongoDBConnection
- TDI-46834 - Additional columns in tDBOutput doesn't generate code properly for MySQL and Oracle
- TDI-46943 - Dynamic schema fail's with Excel
- TDI-46743 - tFileDelete cannot delete xlsx file which is generated by tFileOutputExcel when enable Streaming append and protect and multiple sheets
- TDI-47228 - tPostgresqlOutput: Upsert action not visible when using existing connection.
- TDI-46410 - [7.3.1] issue with tadvancedfileoutputXML after upgrade from 6.1.1
- TDI-47271 - tKafkaCreateTopic cannot work in studio 8.0.1
- TDI-46870 - Upgrade kafka-client to 2.4.0
- TDI-47272 - tfileinputparquet issue with parquet file metadata
- TDI-47222 - [TCK Studio Integration] Stop executed before Flush
- TDI-47122 - Metadata details are not loaded from Snowflake
- TDI-47213 - AzureAdslGen2Output migration failed with regular expression
- TDI-47234 - Job using tXSLT that was working fine before R2021-11 no more works after R2021-11
- TDI-47319 - tKafkaOutput compile error version Kafka 0.8.2.0
- TDM-9200 - the special characters generated in the output XML file in 7.3.1
- TDM-9043 - JSON Reader supporting expressions as discriminators
- TDM-9125 - TDM: Group By doesn't work with multiple entries
- TDM-9197 - get error when install TDM feature to esb runtime
- TDM-8449 - Support JSONL
- TDM-8488 - Flattening map throw error when choose blank structure
- TDM-9017 - PutValueToExternalMap value is converted to String if a Java function is used
- TDM-9038 - JSON sample importer creates untyped element for {}
- TDM-9076 - Avro exporter fails for operands defined after expression
- TDM-9078 - Avro exporter fails to export expressions set on Choices
- TDM-9092 - SecondChoice, which passes the IsPresent expr, is not parsed/highlighted
- TDM-9157 - Distinct Loop with Child Loop using IndexRangeLoop has XPathException
- TDM-9174 - tuj job tdmTDMT627csv_writer is failed with JSON syntax error
- TDM-9176 - Upgrade codehaus.jackson dependency to 1.9.16-TALEND
- TDM-9203 - JSON default choice handler fails on optional array
- TDM-9208 - Expressions in a map with JSON reps are not exported in avro schema
- APPINT-34210 - The microservice jar could not be generated when route with cREST as client + saml
- APPINT-34013 - "Component must have a valid id" when adding <cxf:bus> element in route's spring tab
- APPINT-34077 - RuntimeException: java.lang.NoClassDefFoundError: org/apache/cxf/databinding/DataBinding
- APPINT-34052 - Issue while overriding microservice context param with commandline
- APPINT-34157 - No task created when publishing a microservice to Cloud from Studio 8
- APPINT-34048 - Sync up the Region names of cAWSConnection
- APPINT-34088 - [CI] Mvn deploy job to tmc failed when use default environment
- TBD-12184 - Password field missing for tImpalaRow
- TBD-12809 - Compile error on Spark job with Hive components using EMR 5.29 cluster
- TBD-13202 - Compile error when tFileStreamInputParquet in streaming job
- TBD-13283 - Snowflake - upgrade spark connector and jdbc driver
- TBD-13289 - Cloudera dynamic distributions issues on Studio 8
- TBD-13297 - Unable to compile and build the job after R2021-11 patch
- TBD-13303 - tImpalaConnection - Impala driver ClassNotFoundException
- TBD-13306 - Header is loaded into target file as a record though hive query has ignored the header
- TBD-13309 - CVE on commons-httpclient-3.0.1
- TBD-13310 - CVE: jackson-mapper(core)-asl-1.9.16-TALEND
- TBD-13323 - Unable to compile Talend Big Data job having data type as BigDecimal in 'tDeltaLakeOutput' component.
- TBD-13327 - "Duplicate field in record" error while opening spark job in studio
- TBD-13464 - Many Compile error when I run new create spark job with HDI4
- TBD-13465 - ClassNotFoundException when I run a simple job with CDP711
- TDQ-19846 - Snowflake: Improved the performance of the DQ data mart
- TDQ-19741 - Snowflake: Correct 'RUN TIME' in generated report file
- TDQ-19163 - tDataMasking: Removed a few unsupported data types to prevent the Job from failing
- TDQ-20005 - Fixed the error preventing the name of business rules from being changed in the data mart
- TDQ-20000 - Column Set Analysis: Fixed the error preventing from generating a report into Snowflake datamart
- TDQ-19925 - tDataMasking: Fixed the NoClassFound error when using the function Bank account generation on Amazon EMR 6.2
Security CVEs fixed
CVE-2012-0881 (xercesImpl-2.9.1.jar), impacted:
Studio
SourceClear Premium (No CVE) (jackson-mapper-asl-1.9.15-TALEND,jackson-core-asl-1.9.15-TALEND), impacted:
Studio
DI Components
DQ Components
SourceClear Premium (No CVE) (maven-core-3.8.1), impacted:
Studio
Build
DQ Components
CVE-2021-36373 (ant-1.10.9.jar), impacted:
Build, publish docker images
CVE-2015-5237 (protobuf-java-2.5.0.jar), impacted:
DI Components
CVE-2021-37136, CVE-2021-37137 (netty-codec-4.0.33.Final.jar,netty-codec-4.1.65.Final.jar), impacted:
DI Components
Cassandra metadata
CVE-2021-45105 (log4j-core-2.16.0.jar, log4j-1.2-api-2.16.0.jar), impacted:
DI Components
DQ Components
APPINT Components
Studio
CVE-2012-5785 (axis2-kerne-1.8.0.jar), impacted:
Studio
CVE-2021-22144 (elasticsearch-7.3.2.jar), impacted:
Studio
New features in R2021-12
- TUP-33718 - Genereate component - jar index data
- TUP-26972 - Prompt to Automatically push changes to Remote Branch
- TUP-22589 - Improve error messages when pushing to read-only GIT branches
- TUP-32064 - Build up to date Studio index automatically
- TUP-33198 - Support retrieve SAP ADSO service metadata with SAP JCO3
- TDI-44717 - [tPostgresqlOutput] Support upsert using "on conflict" clause to enable batch size
- TDI-45710 - tXSLT support for streaming input and output
- TDI-46936 - Cloud- cloud TDS job fails with connection timeout error while reaching to campaign
- TDI-45793 - Extracting data from SAP BW4HANA without direct connection to DB
- TDI-45940 - Workday Raas/Soap supporting Oauth
- TDI-45016 - Add a configurable Query Timeout field to AS400 connection components
- TDI-44609 - Support custom URI for MongoDB Atlas
- TDI-46517 - MongoDB connectivity Authentication with x.509
- APPINT-34089 - Project analysis task - Warn about duplicated routeId usage
- APPINT-33726 - SNS component in Route to support FIFO
- APPINT-34095 - tRESTRequest now accepts to have multipart as optional
- APPINT-33956 - Project analysis task - Seek for components unresolved dependencies
Fixed issues in R2021-12
- TUP-34105 - Upgraded log4j2 to 2.16.0 for CVE-2021-44228 and CVE-2021-45046
- TUP-34155 - Can't build spark job that use HDI4
- TUP-34094 - Add progressbar for patch update when launching studio
- TUP-33792 - No "Data viewer" for lite studio by default
- TUP-32838 - Custom value in a table column with suggestable values is not allowed
- TUP-33882 - Data preview failed if tSnowflakeInput using exist connection
- TUP-33659 - JETL: "xxxClassNotFoundException: xxx" Error shows in Errorlog after loging into project
- TUP-33854 - JETL studio can't install patch
- TUP-33791 - Error pops up while running job in main project and it call childjob from reference project
- TUP-33734 - Patched new features can't be shown in feature manager if it is located in a deeper category which level more than one
- TUP-33822 - Can't update new patch successfully if last patch is installed from a sub profile (a project which required features less than studio installed)
- TUP-33570 - Retrieve hadoop config from Ambari / Cloudera seems not working
- TUP-33667 - Branch in "auto commit mode" switch to a "Use manual commit mode" branch will popup Uncommitted files found dialog
- TUP-33199 - [Feature Manager->Cancel installation] After clicking on the "Cancel Operation" during installation, "Restart Studio" dialog was popped up which is improper.
- TUP-33735 - "Hierarchical Mapper" can't show properly when switch git branch
- TUP-33692 - Studio reset the ref project version to studio version in some case .
- TUP-33443 - The method tFileInputDelimited1onSubJobError(Exception, String, Map<String,Object>) is undefined for the type xxxxx
- TUP-33713 - Logon popup message in a mess when main project and refer project are on different patch
- TUP-34096 - failed to logon the project, after clicking NO on the patch update restart dialog
- TUP-33445 - Add configurable parameters for MDM Service Request
- TUP-33467 - Need to adjust the UI of 'check connection' when tck component in studio
- TUP-33497 - Bug in tDBOutput component when linking rejects to tMap
- TUP-33533 - Studio generates .bat file with LF as 'End of Line (or new line)' character instead of CRLF
- TUP-33564 - MDM: Met some issue when add Reference Entity in "Edit Business Element" dialog
- TUP-33685 - Update version not saved into project if migrate a project by switch branch.
- TUP-33731 - Remote Project: when do pull and merge for add/remove reference project, ConcurrentModificationException show in error log
- TUP-33617 - java.io.OptionalDataException on tAvroInput
- TUP-33709 - "Failed to create assembly" when compile a BD job with studio commandline
- TUP-33755 - Update wizard error text not wrap if there is something wrong with the update p2
- TUP-33834 - SVN shown in the listProject command help in CommandLine
- TUP-33807 - Sybase ASE Triggers generated by CDC don't work when multiple lines are affected
- TUP-33833 - Fail to log on a project if switch from tpall license to tdi license and the studio installed all feature and a patch
- TUP-32940 - Remove "Also search from Help when performing a component searching"
- TUP-33746 - Feature manager :Active/Deactive Features: "Resotre Defaults" not work
- TUP-33728 - Migrate studio65 job to 801, miss DB connection
- TUP-33121 - Talend Studio gives no error if unable to connect to remote GIT repository
- TUP-33230 - Update patch: need restart to make new patch work for artifactory
- TUP-34140 - run job with tRunJob failed if user B logon a project that user A installed some features contain routine
- TUP-34141 - can't pull the changes of requiredFeatures.json for local mode
- TUP-34149 - JETL: Cannot install patch completely
- TDI-46912 - [tELTOutput] "Drop table if exists and create” does not work
- TDI-46930 - compile error on tFileOutputDelimited after installing the cumulative patch
- TDI-46984 - tFTPGet component unable to get file from FileZilla Server, with a particular Filemask in Studio, after September patch, Patch20210924R2021-09_v2-7.3.1
- TDI-46791 - tBigQueryInput - Component returning extra row of NULL values
- TDI-46905 - tFTPPut treat absolute path FTP server.
- TDI-47170 - tFTPPut treat absolute path sFTP server.
- TDI-46992 - Could the fix for TDI-46373 might have introduced a regression - a limit to the content log - java.nio.BufferOverflowException
- TDI-47179 - tPostgresqlOutput: enable "Batch" checkbox for Upsert action.
- TDI-47005 - In tsalesforceoutput component UPSERT is working even though columns were not aligned
- TDI-46932 - tSAPInput component parses TIMS Midnight as null when using dynamic schema
- TDI-47147 - tmap failed with first match with cache in file
- TDI-47078 - [7.3]Multiple SQL Statements in SQL Template => Duplicate local variable
- TDI-46962 - tAmazonAuoraOutput compilation errors
- TDI-46850 - Upgrade ActiveMQ Jars
- TDM-8894 - Update can't be detected when delete invalid element which used by function
- TDM-9039 - JSON sample importer should process JSONL/NDJson files
- TDM-9089 - Stream job run fail with eclipse runtime
- TDM-9107 - IsPresent value is not created correctly from the imported AVSC
- TDM-9116 - Streamline and trace dirty flag management
- TDM-9133 - regression: retest TDM-8173 and will return error
- TDM-9134 - Relax controls on parent looping expressions for grouping nested loops
- TDM-9139 - tHMap will get the error when first time run if "unroll from loop"
- TDM-9142 - Missing/Incomplete MANIFEST.MF
- TDM-9144 - Align slf4j (maybe others) between standalone target platform and Studio
- TDM-9145 - Distinct on Attribute of type integer is sorted by String
- TDM-9146 - clean unused message
- TDM-9178 - CVE: org.hibernate:hibernate-core:[5.0.9-5.3.20.Final]
- TDQ-19920 - tMatchGroup: Job failed when using a shared connection
- TDQ-17188 - Remote project: Report with 8 analyses failed with the error "Can't execute now"
- TDQ-19849 - tVerifyEmail: Job couldn't be executed on some networks when Check with mail server callback was selected
- TDQ-19750 - Talend Exchange: Activated some indicators, regexes and rules for 8.0
- TDQ-19884 - Fixed the error preventing to import from talend Exchange
- TDQ-19886 - Semantic-aware analysis: Enhanced an error message
- TDQ-19293 - tData(Un)Masking: Enhanced some function names
- TDQ-19834 - CVE: org.apache.jena upgraded to 4.2.0
- TDQ-19203 - Analysis: Studio was unavailable while opening an analysis
- APPINT-34090 - Studio esb/osgi-exclude.properties doesn't work any more
- APPINT-34030 - git commit ID inconsistent when publishing artifact to Cloud.
- APPINT-33788 - Unexpected waiting for javax.sql.DataSource dependencies (part 2)
- APPINT-32136 - Job & Run view displays DI job icon and/or label when a route or routelet editor is active
- APPINT-34059 - Build DemoREST as OSGI failed with offline with error Unresolveable build extension
- APPINT-34073 - NoSuchEndpointException when run route with cAWSConnection + cAWSSQS
- APPINT-33820 - Add setting of owner ESB task as MDC for logging of REST routes and services (backport)
- APPINT-34113 - CXFRS jackson json provider issue
- APPINT-34061 - Missing import for net.sf.saxon.TransformerFactoryImpl
- APPINT-34099 - tRestClient with option "Convert response to DOM document" throw error when receiving 204 response
- APPINT-34066 - [MacOS Big Blure]Fail to build route as OSGI to runtime with ClassNotFoundException on MacOS
- APPINT-34009 - [TCK][Studio] Unable to run Neo4jV4 and CosmosAPI in Microservice Mode
- TBD-13301 - Expression within tMap doesn't compile due to invalidAssignmentOperator; even though the column exists in the input schema
- TBD-13284 - Compile error on Spark job with tMap component
- TBD-13268 - Class not Found encountered when running Spark job against S3
- TBD-13244 - Failed to add json-smart-2.4.7-LATEST.jar to Spark environment
- TBD-13242 - [Spark Streaming] tFileOutputDelimited components sometimes doesn't write byte[] data
- TBD-13238 - java.lang.IllegalArgumentException: Field "entity_name" does not exist.
- TBD-13236 - "Use SSE-KMS encryption" property is absent for tS3Configuration component when EMR distribution is selected
- TBD-13232 - java.lang.String is not a valid external type for schema of bigint
- TBD-13231 - Compile error when tHiveInput in streaming job
- TBD-13227 - java.math.BigDecimal is not a valid external type for schema of int
- TBD-13220 - Nullpointerexception using Cross Join in Spark
- TBD-13203 - Compile error when tCassandraOutput/tCassandraInput in streaming job
- TBD-13199 - Wrong driver cores value is set in spark config when Synapse from repository is used
- TBD-13198 - Wrong tunning properties field name in Synapse wizard
- TBD-13195 - [Talend 8, Azure Synapse] Compile error "org.talend.bigdata cannot be resolved to a type" on simple Batch/Streaming job
- TBD-13194 - Databricks launcher reuploads already existing libs
- TBD-13187 - Compile error on tLogRow when byteArray type is used
- TBD-13175 - EMR 6.2 fails when job contains tDatamasking component
- TBD-13148 - Decimal precision needs to be provided in tHiveOutput schema Component in 7.3.1
- TBD-13139 - Default value defined in tAggregateRow is not taken into account
- TBD-13138 - A schema mismatch detected when writing to the Delta table
- TBD-13128 - HWC doesn't work when using a cluster with Kerberos+SSL
- TBD-13120 - ClassNotFoundException on streaming job with tKafkaInput running on spark local 3.0
- TBD-13102 - Data Load from kafka to Data Bricks in spark streaming job
- TBD-13373 - User did not initialize spark context when I run a simple spark job with HDI4
- TBD-13201 - Spark job running on Synapse failed with IllegalStateException
Security CVEs fixed
CVE-2021-44228, CVE-2021-45046 (log4j-core-2.13.2.jar, log4j-core-2.14.1.jar), impacted:
DI Components
DQ Components
APPINT Components
Studio
metadata bridge
CVE-2020-28052 (bcprov-jdk15on-1.62.jar), impacted:
Studio
SourceClear Premium (No CVE) (oauth2-oidc-sdk-6.5.jar,adal4j-1.6.5.jar), impacted:
DI Components
Microsoft SQL Server database metadata
SourceClear Premium (No CVE) (commons-codec-1.11), impacted:
Build, publish docker images
CVE-2021-37714 (jsoup-1.11.2.jar), impacted:
DI Components
CVE-2015-5237 (protobuf-java-3.3.0.jar), impacted:
DI Components
CVE-2021-28168 (jersey-common-2.30.jar), impacted:
DI Components
CVE-2021-39239 (jena-core-2.10.0.jar), impacted:
DI Components
DQ Profiling
CWE-327(bcprov-jdk15on-1.69.jar), impacted:
DI Components
CVE-2021-40690 (xmlsec-2.2.0.jar), impacted:
APPINT Components
CVE-2021-37137 (netty-codec-4.1.50.Final.jar,netty-codec-4.1.59.Final.jar), impacted:
APPINT Components
CVE-2021-20328 (mongodb-driver-core-4.2.3.jar,mongodb-driver-sync-4.2.3.jar,bson-4.2.3.jar,mongo-java-driver-3.12.8.jar), impacted:
DI Components
BD Components
MongoDB metadata
CVE-2021-35517 (commons-compress-1.18.jar), impacted:
metadata bridge