version: 8.0.1
module: https://talend.poolparty.biz/coretaxonomy/42
product: https://talend.poolparty.biz/coretaxonomy/183
R2022-01
Info |
Value |
Patch name |
Patch_20220121_R2022-01_v1-8.0.1 |
Release date |
2022-01-21 |
Target version |
20211109_1610-8.0.1 |
Product affected |
Talend Studio |
Introduction
This monthly release includes all previous generally available patches for Talend Studio 8.0.1.
For more information about the new features and bug fixes included in this monthly release, see:
Prerequisites
Consider the following requirements for your system:
- Talend Studio 8.0.1 must be installed.
Installation
Before applying an update to Talend Studio, check:
Note:
A number of jars have been upgraded in this update patch. To avoid confusion, after installing this patch you can delete the CVE impacted versions from your local studio directory and artifact repository. For example, for an old log4j jar:
remove <studio>/configuration/.m2/repository/org/apache/logging/log4j/log4j-core/<version>/log4j-core-<version>.jar
remove the jar from your artifact repository:
Where <studio> is your studio installation folder and <version> is the CVE impacted version. For the upgrade information and the specific impacted versions, see the "Fixed issues" and "Security CVEs" parts of this documentation.
Installing the patch via setting up the Update URL in Talend Studio (recommended)
If your Talend Studio supports installing features using the Feature Manager wizard, it can detect and notify you about available patches and install the patches automatically when the Update URL is correctly set up in Talend Studio.
For more information about the Feature Manager wizard, see Managing features in Talend Studio.
For more information about setting up the Update URL, see Setting up the Update URL of Talend Studio.
Installing the patch using Software update in Talend Administration Center (for on-premises users)
- Log in to Talend Administration Center and go to Settings->Configuration->Software Update. Enter the correct values and save them referring to the documentation Configuring the Software Update repository in Talend Administration Center.
- Download the patch from the Settings->Software Update page into the nexus repository.
- Log in to Talend Studio in the remote mode.
- If your Studio supports installing features using the Feature Manager, go to the the Feature Manager to proceed with patch installation; otherwise, click the Update button displayed on the login window to install the patch.
Installing the patch using Continuous Integration
To install the patch using the CI builder, use the -Dtalend.studio.p2.update
option at build time.
For more information, see Building and Deploying.
Installing the patch manually using Talend Studio
- Download the patch from the repository for Talend updates manually.
- Create a folder named "patches" in your Studio installation directory and copy the patch .zip file to this folder.
- Restart your Studio.
- If your Studio supports installing features using the Feature Manager, log in to your project and go to the the Feature Manager to proceed with patch installation; otherwise, click OK when prompted to install the patch.
New features in R2022-01
- TUP-33284 - Allow Publishing to cloud only if the job items are committed and pushed to Git
- TUP-32059 - Add git info in the jobinfo.properties when building job from CI
- TUP-33610 - Remove deprecated item in NoSQL connections.
- TDI-46470 - tKafkaOutput NB_LINES and other statistical after variables
- TDI-46430 - tKafka to handle Avro data in DI jobs
- TDI-46806 - Azure Blob Storage supporting the latest API version
- TDI-46460 - Integrate Apache Kudu / TCK in Studio
- TDI-47330 - Improved error logging for ODP and ADSO input
- TDI-46837 - tELTSAPMap: Improved logging for SAP components
- TDI-46093 - Add connection component for Tck ADLS gen2
- TDI-46875 - Implement $inc in MongoDBOutput in order to increment the value of existing field
- TDI-46698 - MongoDB add .skip / .batchSize options to input
- TDI-46627 - Upsert and push functionality in tmongodboutput component
- TDI-46665 - TCOMPv0 (Daikon) to support java 17 (runtime)
- TDI-46151 - Filter data based on return value in subquery in source database before pushing it down to a tDBInput to execute
- TDI-46093 - Add connection component for Tck ADLS gen2
- APPINT-34208 - Publish to cloud from CI: provide project/GIT informations in published artifact model
- APPINT-33784 - Project analysis task - Warn about custom component dependencies risk
- TBD-13144 - Upgrade kafka to 2.4.0
- TBD-13222 - Remove deprecated version for NoSQL in spark/spark stream components.
- TBD-13262 - HWC/Knox job is not able to connect to cluster
- TBD-13254 - Smoke test CDP Atlas
- TBD-13381 - Simplify drop-down naming for Cloudera CDP distribution
- TBD-13389 - Tech preview - CDP Public Cloud with Knox (official certification)
- TDQ-19814 - tDataQualityRules: New component to use DQ rules in the Studio
Fixed issues in R2022-01
- TUP-34111 - [7.3.1] slow studio build time for remote execution, compared to local exec, or build job with R2021-01 or higher
- TUP-33966 - Studio/commandline fails to generate code for the job, throws "Invalid thread access"
- TUP-33369 - Need restart Studio to show FeatureList after network is broken and fixed later
- TUP-33964 - Integrate Apache Kudu Connector
- TUP-33863 - Update of Metadata Hadoop Cluster does not change spark version when propagated
- TUP-34123 - 'talendcsv-1.0.0.jar' is missing on 'Guess Schema' operation
- TUP-33939 - Ubuntu: Cannot close "Quick Tour" after logon a migrated project with a new extracted Studio
- TUP-34312 - Remove the signer from CI builder
- TUP-33185 - [CI] Cannot read .project file
- TUP-33830 - [7.3] ref project compilation error
- TUP-33962 - Error in handling default value as NULL
- TUP-34095 - Feature Manager> what's new is not expected to be to editable
- TUP-34356 - Improve update wizard to expand the what's new scroll pane according to the size of the dialog
- TUP-34127 - Feature manager should popup error if update version is lower than studio version
- TUP-30975 - Can't move Couchbase connection to folder
- TUP-33897 - Remove username from Studio Cloud Login
- TUP-33644 - TMC: error pop up when uncheck "use manual commit mode" and check out as local branch
- TUP-33776 - "Enable Parallel execution" in tOracleInput and tRESTClient
- TUP-34274 - [8.0] missing tesbconsumner component in studio with data management license
- TUP-34405 - Feature ESBConsumer is not active after import in a 73 existing project.
- TUP-33883 - Commandline upgrade script can't load update url from studio configuration
- TUP-34440 - Missing some tcompv0 basic plugins updates in 8.0 patch
- TUP-33214 - Migrated 731 project could not show the build popup for job build operation and gives error(IllegalArgumentException: Comparison method violates its general contract!) in macOS
- TDI-46910 - [tELTMap] The way to escape Db Column in multi-byte character in is different between input and output
- TDI-44321 - Update misleading text on SSL connection in tMongoDBConnection
- TDI-46834 - Additional columns in tDBOutput doesn't generate code properly for MySQL and Oracle
- TDI-46943 - Dynamic schema fail's with Excel
- TDI-46743 - tFileDelete cannot delete xlsx file which is generated by tFileOutputExcel when enable Streaming append and protect and multiple sheets
- TDI-47228 - tPostgresqlOutput: Upsert action not visible when using existing connection.
- TDI-46410 - [7.3.1] issue with tadvancedfileoutputXML after upgrade from 6.1.1
- TDI-47271 - tKafkaCreateTopic cannot work in studio 8.0.1
- TDI-46870 - Upgrade kafka-client to 2.4.0
- TDI-47272 - tfileinputparquet issue with parquet file metadata
- TDI-47222 - [TCK Studio Integration] Stop executed before Flush
- TDI-47122 - Metadata details are not loaded from Snowflake
- TDI-47213 - AzureAdslGen2Output migration failed with regular expression
- TDI-47234 - Job using tXSLT that was working fine before R2021-11 no more works after R2021-11
- TDI-47319 - tKafkaOutput compile error version Kafka 0.8.2.0
- TDM-9200 - the special characters generated in the output XML file in 7.3.1
- TDM-9043 - JSON Reader supporting expressions as discriminators
- TDM-9125 - TDM: Group By doesn't work with multiple entries
- TDM-9197 - get error when install TDM feature to esb runtime
- TDM-8449 - Support JSONL
- TDM-8488 - Flattening map throw error when choose blank structure
- TDM-9017 - PutValueToExternalMap value is converted to String if a Java function is used
- TDM-9038 - JSON sample importer creates untyped element for {}
- TDM-9076 - Avro exporter fails for operands defined after expression
- TDM-9078 - Avro exporter fails to export expressions set on Choices
- TDM-9092 - SecondChoice, which passes the IsPresent expr, is not parsed/highlighted
- TDM-9157 - Distinct Loop with Child Loop using IndexRangeLoop has XPathException
- TDM-9174 - tuj job tdmTDMT627csv_writer is failed with JSON syntax error
- TDM-9176 - Upgrade codehaus.jackson dependency to 1.9.16-TALEND
- TDM-9203 - JSON default choice handler fails on optional array
- TDM-9208 - Expressions in a map with JSON reps are not exported in avro schema
- APPINT-34210 - The microservice jar could not be generated when route with cREST as client + saml
- APPINT-34013 - "Component must have a valid id" when adding <cxf:bus> element in route's spring tab
- APPINT-34077 - RuntimeException: java.lang.NoClassDefFoundError: org/apache/cxf/databinding/DataBinding
- APPINT-34052 - Issue while overriding microservice context param with commandline
- APPINT-34157 - No task created when publishing a microservice to Cloud from Studio 8
- APPINT-34048 - Sync up the Region names of cAWSConnection
- APPINT-34088 - [CI] Mvn deploy job to tmc failed when use default environment
- TBD-12184 - Password field missing for tImpalaRow
- TBD-12809 - Compile error on Spark job with Hive components using EMR 5.29 cluster
- TBD-13202 - Compile error when tFileStreamInputParquet in streaming job
- TBD-13283 - Snowflake - upgrade spark connector and jdbc driver
- TBD-13289 - Cloudera dynamic distributions issues on Studio 8
- TBD-13297 - Unable to compile and build the job after R2021-11 patch
- TBD-13303 - tImpalaConnection - Impala driver ClassNotFoundException
- TBD-13306 - Header is loaded into target file as a record though hive query has ignored the header
- TBD-13309 - CVE on commons-httpclient-3.0.1
- TBD-13310 - CVE: jackson-mapper(core)-asl-1.9.16-TALEND
- TBD-13323 - Unable to compile Talend Big Data job having data type as BigDecimal in 'tDeltaLakeOutput' component.
- TBD-13327 - "Duplicate field in record" error while opening spark job in studio
- TBD-13464 - Many Compile error when I run new create spark job with HDI4
- TBD-13465 - ClassNotFoundException when I run a simple job with CDP711
- TDQ-19846 - Snowflake: Improved the performance of the DQ data mart
- TDQ-19741 - Snowflake: Correct 'RUN TIME' in generated report file
- TDQ-19163 - tDataMasking: Removed a few unsupported data types to prevent the Job from failing
- TDQ-20005 - Fixed the error preventing the name of business rules from being changed in the data mart
- TDQ-20000 - Column Set Analysis: Fixed the error preventing from generating a report into Snowflake datamart
- TDQ-19925 - tDataMasking: Fixed the NoClassFound error when using the function Bank account generation on Amazon EMR 6.2
Security CVEs fixed
CVE-2012-0881 (xercesImpl-2.9.1.jar), impacted:
Studio
SourceClear Premium (No CVE) (jackson-mapper-asl-1.9.15-TALEND,jackson-core-asl-1.9.15-TALEND), impacted:
Studio
DI Components
DQ Components
SourceClear Premium (No CVE) (maven-core-3.8.1), impacted:
Studio
Build
DQ Components
CVE-2021-36373 (ant-1.10.9.jar), impacted:
Build, publish docker images
CVE-2015-5237 (protobuf-java-2.5.0.jar), impacted:
DI Components
CVE-2021-37136, CVE-2021-37137 (netty-codec-4.0.33.Final.jar,netty-codec-4.1.65.Final.jar), impacted:
DI Components
Cassandra metadata
CVE-2021-45105 (log4j-core-2.16.0.jar, log4j-1.2-api-2.16.0.jar), impacted:
DI Components
DQ Components
APPINT Components
Studio
CVE-2012-5785 (axis2-kerne-1.8.0.jar), impacted:
Studio
CVE-2021-22144 (elasticsearch-7.3.2.jar), impacted:
Studio
New features in R2021-12
- TUP-33718 - Genereate component - jar index data
- TUP-26972 - Prompt to Automatically push changes to Remote Branch
- TUP-22589 - Improve error messages when pushing to read-only GIT branches
- TUP-32064 - Build up to date Studio index automatically
- TUP-33198 - Support retrieve SAP ADSO service metadata with SAP JCO3
- TDI-44717 - [tPostgresqlOutput] Support upsert using "on conflict" clause to enable batch size
- TDI-45710 - tXSLT support for streaming input and output
- TDI-46936 - Cloud- cloud TDS job fails with connection timeout error while reaching to campaign
- TDI-45793 - Extracting data from SAP BW4HANA without direct connection to DB
- TDI-45940 - Workday Raas/Soap supporting Oauth
- TDI-45016 - Add a configurable Query Timeout field to AS400 connection components
- TDI-44609 - Support custom URI for MongoDB Atlas
- TDI-46517 - MongoDB connectivity Authentication with x.509
- APPINT-34089 - Project analysis task - Warn about duplicated routeId usage
- APPINT-33726 - SNS component in Route to support FIFO
- APPINT-34095 - tRESTRequest now accepts to have multipart as optional
- APPINT-33956 - Project analysis task - Seek for components unresolved dependencies
Fixed issues in R2021-12
- TUP-34105 - Upgraded log4j2 to 2.16.0 for CVE-2021-44228 and CVE-2021-45046
- TUP-34155 - Can't build spark job that use HDI4
- TUP-34094 - Add progressbar for patch update when launching studio
- TUP-33792 - No "Data viewer" for lite studio by default
- TUP-32838 - Custom value in a table column with suggestable values is not allowed
- TUP-33882 - Data preview failed if tSnowflakeInput using exist connection
- TUP-33659 - JETL: "xxxClassNotFoundException: xxx" Error shows in Errorlog after loging into project
- TUP-33854 - JETL studio can't install patch
- TUP-33791 - Error pops up while running job in main project and it call childjob from reference project
- TUP-33734 - Patched new features can't be shown in feature manager if it is located in a deeper category which level more than one
- TUP-33822 - Can't update new patch successfully if last patch is installed from a sub profile (a project which required features less than studio installed)
- TUP-33570 - Retrieve hadoop config from Ambari / Cloudera seems not working
- TUP-33667 - Branch in "auto commit mode" switch to a "Use manual commit mode" branch will popup Uncommitted files found dialog
- TUP-33199 - [Feature Manager->Cancel installation] After clicking on the "Cancel Operation" during installation, "Restart Studio" dialog was popped up which is improper.
- TUP-33735 - "Hierarchical Mapper" can't show properly when switch git branch
- TUP-33692 - Studio reset the ref project version to studio version in some case .
- TUP-33443 - The method tFileInputDelimited1onSubJobError(Exception, String, Map<String,Object>) is undefined for the type xxxxx
- TUP-33713 - Logon popup message in a mess when main project and refer project are on different patch
- TUP-34096 - failed to logon the project, after clicking NO on the patch update restart dialog
- TUP-33445 - Add configurable parameters for MDM Service Request
- TUP-33467 - Need to adjust the UI of 'check connection' when tck component in studio
- TUP-33497 - Bug in tDBOutput component when linking rejects to tMap
- TUP-33533 - Studio generates .bat file with LF as 'End of Line (or new line)' character instead of CRLF
- TUP-33564 - MDM: Met some issue when add Reference Entity in "Edit Business Element" dialog
- TUP-33685 - Update version not saved into project if migrate a project by switch branch.
- TUP-33731 - Remote Project: when do pull and merge for add/remove reference project, ConcurrentModificationException show in error log
- TUP-33617 - java.io.OptionalDataException on tAvroInput
- TUP-33709 - "Failed to create assembly" when compile a BD job with studio commandline
- TUP-33755 - Update wizard error text not wrap if there is something wrong with the update p2
- TUP-33834 - SVN shown in the listProject command help in CommandLine
- TUP-33807 - Sybase ASE Triggers generated by CDC don't work when multiple lines are affected
- TUP-33833 - Fail to log on a project if switch from tpall license to tdi license and the studio installed all feature and a patch
- TUP-32940 - Remove "Also search from Help when performing a component searching"
- TUP-33746 - Feature manager :Active/Deactive Features: "Resotre Defaults" not work
- TUP-33728 - Migrate studio65 job to 801, miss DB connection
- TUP-33121 - Talend Studio gives no error if unable to connect to remote GIT repository
- TUP-33230 - Update patch: need restart to make new patch work for artifactory
- TUP-34140 - run job with tRunJob failed if user B logon a project that user A installed some features contain routine
- TUP-34141 - can't pull the changes of requiredFeatures.json for local mode
- TUP-34149 - JETL: Cannot install patch completely
- TDI-46912 - [tELTOutput] "Drop table if exists and create” does not work
- TDI-46930 - compile error on tFileOutputDelimited after installing the cumulative patch
- TDI-46984 - tFTPGet component unable to get file from FileZilla Server, with a particular Filemask in Studio, after September patch, Patch20210924R2021-09_v2-7.3.1
- TDI-46791 - tBigQueryInput - Component returning extra row of NULL values
- TDI-46905 - tFTPPut treat absolute path FTP server.
- TDI-47170 - tFTPPut treat absolute path sFTP server.
- TDI-46992 - Could the fix for TDI-46373 might have introduced a regression - a limit to the content log - java.nio.BufferOverflowException
- TDI-47179 - tPostgresqlOutput: enable "Batch" checkbox for Upsert action.
- TDI-47005 - In tsalesforceoutput component UPSERT is working even though columns were not aligned
- TDI-46932 - tSAPInput component parses TIMS Midnight as null when using dynamic schema
- TDI-47147 - tmap failed with first match with cache in file
- TDI-47078 - [7.3]Multiple SQL Statements in SQL Template => Duplicate local variable
- TDI-46962 - tAmazonAuoraOutput compilation errors
- TDI-46850 - Upgrade ActiveMQ Jars
- TDM-8894 - Update can't be detected when delete invalid element which used by function
- TDM-9039 - JSON sample importer should process JSONL/NDJson files
- TDM-9089 - Stream job run fail with eclipse runtime
- TDM-9107 - IsPresent value is not created correctly from the imported AVSC
- TDM-9116 - Streamline and trace dirty flag management
- TDM-9133 - regression: retest TDM-8173 and will return error
- TDM-9134 - Relax controls on parent looping expressions for grouping nested loops
- TDM-9139 - tHMap will get the error when first time run if "unroll from loop"
- TDM-9142 - Missing/Incomplete MANIFEST.MF
- TDM-9144 - Align slf4j (maybe others) between standalone target platform and Studio
- TDM-9145 - Distinct on Attribute of type integer is sorted by String
- TDM-9146 - clean unused message
- TDM-9178 - CVE: org.hibernate:hibernate-core:[5.0.9-5.3.20.Final]
- TDQ-19920 - tMatchGroup: Job failed when using a shared connection
- TDQ-17188 - Remote project: Report with 8 analyses failed with the error "Can't execute now"
- TDQ-19849 - tVerifyEmail: Job couldn't be executed on some networks when Check with mail server callback was selected
- TDQ-19750 - Talend Exchange: Activated some indicators, regexes and rules for 8.0
- TDQ-19884 - Fixed the error preventing to import from talend Exchange
- TDQ-19886 - Semantic-aware analysis: Enhanced an error message
- TDQ-19293 - tData(Un)Masking: Enhanced some function names
- TDQ-19834 - CVE: org.apache.jena upgraded to 4.2.0
- TDQ-19203 - Analysis: Studio was unavailable while opening an analysis
- APPINT-34090 - Studio esb/osgi-exclude.properties doesn't work any more
- APPINT-34030 - git commit ID inconsistent when publishing artifact to Cloud.
- APPINT-33788 - Unexpected waiting for javax.sql.DataSource dependencies (part 2)
- APPINT-32136 - Job & Run view displays DI job icon and/or label when a route or routelet editor is active
- APPINT-34059 - Build DemoREST as OSGI failed with offline with error Unresolveable build extension
- APPINT-34073 - NoSuchEndpointException when run route with cAWSConnection + cAWSSQS
- APPINT-33820 - Add setting of owner ESB task as MDC for logging of REST routes and services (backport)
- APPINT-34113 - CXFRS jackson json provider issue
- APPINT-34061 - Missing import for net.sf.saxon.TransformerFactoryImpl
- APPINT-34099 - tRestClient with option "Convert response to DOM document" throw error when receiving 204 response
- APPINT-34066 - [MacOS Big Blure]Fail to build route as OSGI to runtime with ClassNotFoundException on MacOS
- APPINT-34009 - [TCK][Studio] Unable to run Neo4jV4 and CosmosAPI in Microservice Mode
- TBD-13301 - Expression within tMap doesn't compile due to invalidAssignmentOperator; even though the column exists in the input schema
- TBD-13284 - Compile error on Spark job with tMap component
- TBD-13268 - Class not Found encountered when running Spark job against S3
- TBD-13244 - Failed to add json-smart-2.4.7-LATEST.jar to Spark environment
- TBD-13242 - [Spark Streaming] tFileOutputDelimited components sometimes doesn't write byte[] data
- TBD-13238 - java.lang.IllegalArgumentException: Field "entity_name" does not exist.
- TBD-13236 - "Use SSE-KMS encryption" property is absent for tS3Configuration component when EMR distribution is selected
- TBD-13232 - java.lang.String is not a valid external type for schema of bigint
- TBD-13231 - Compile error when tHiveInput in streaming job
- TBD-13227 - java.math.BigDecimal is not a valid external type for schema of int
- TBD-13220 - Nullpointerexception using Cross Join in Spark
- TBD-13203 - Compile error when tCassandraOutput/tCassandraInput in streaming job
- TBD-13199 - Wrong driver cores value is set in spark config when Synapse from repository is used
- TBD-13198 - Wrong tunning properties field name in Synapse wizard
- TBD-13195 - [Talend 8, Azure Synapse] Compile error "org.talend.bigdata cannot be resolved to a type" on simple Batch/Streaming job
- TBD-13194 - Databricks launcher reuploads already existing libs
- TBD-13187 - Compile error on tLogRow when byteArray type is used
- TBD-13175 - EMR 6.2 fails when job contains tDatamasking component
- TBD-13148 - Decimal precision needs to be provided in tHiveOutput schema Component in 7.3.1
- TBD-13139 - Default value defined in tAggregateRow is not taken into account
- TBD-13138 - A schema mismatch detected when writing to the Delta table
- TBD-13128 - HWC doesn't work when using a cluster with Kerberos+SSL
- TBD-13120 - ClassNotFoundException on streaming job with tKafkaInput running on spark local 3.0
- TBD-13102 - Data Load from kafka to Data Bricks in spark streaming job
- TBD-13373 - User did not initialize spark context when I run a simple spark job with HDI4
- TBD-13201 - Spark job running on Synapse failed with IllegalStateException
Security CVEs fixed
CVE-2021-44228, CVE-2021-45046 (log4j-core-2.13.2.jar, log4j-core-2.14.1.jar), impacted:
DI Components
DQ Components
APPINT Components
Studio
metadata bridge
CVE-2020-28052 (bcprov-jdk15on-1.62.jar), impacted:
Studio
SourceClear Premium (No CVE) (oauth2-oidc-sdk-6.5.jar,adal4j-1.6.5.jar), impacted:
DI Components
Microsoft SQL Server database metadata
SourceClear Premium (No CVE) (commons-codec-1.11), impacted:
Build, publish docker images
CVE-2021-37714 (jsoup-1.11.2.jar), impacted:
DI Components
CVE-2015-5237 (protobuf-java-3.3.0.jar), impacted:
DI Components
CVE-2021-28168 (jersey-common-2.30.jar), impacted:
DI Components
CVE-2021-39239 (jena-core-2.10.0.jar), impacted:
DI Components
DQ Profiling
CWE-327(bcprov-jdk15on-1.69.jar), impacted:
DI Components
CVE-2021-40690 (xmlsec-2.2.0.jar), impacted:
APPINT Components
CVE-2021-37137 (netty-codec-4.1.50.Final.jar,netty-codec-4.1.59.Final.jar), impacted:
APPINT Components
CVE-2021-20328 (mongodb-driver-core-4.2.3.jar,mongodb-driver-sync-4.2.3.jar,bson-4.2.3.jar,mongo-java-driver-3.12.8.jar), impacted:
DI Components
BD Components
MongoDB metadata
CVE-2021-35517 (commons-compress-1.18.jar), impacted:
metadata bridge