Hi Talend team, We are getting the same 'ConcurrentModificationException' issue in tMDMoutput component while running our job from TAC, we are using talend 5.2.2 version (Talend Platform for MDM). ÃÂ we are sending 11185 rows to tMDMoutput component. is this the reason for this failure ? Thanks in advance. My error message: AutoMerge Part3 has been started Exception in component tMDMOutput_11_In AxisFault ÃÂ faultCode: {}Server ÃÂ faultSubcode:ÃÂ ÃÂ faultString: null; nested exception is:ÃÂ java.lang.RuntimeException: java.util.ConcurrentModificationException ÃÂ faultActor:ÃÂ ÃÂ faultNode:ÃÂ ÃÂ faultDetail:ÃÂ {}stackTrace:null; nested exception is:ÃÂ java.lang.RuntimeException: java.util.ConcurrentModificationException at org.apache.axis.message.SOAPFaultBuilder.createFault(SOAPFaultBuilder.java:222) at org.apache.axis.message.SOAPFaultBuilder.endElement(SOAPFaultBuilder.java:129) at org.apache.axis.encoding.DeserializationContext.endElement(DeserializationContext.java:1087) at org.apache.xerces.parsers.AbstractSAXParser.endElement(Unknown Source) at org.apache.xerces.impl.XMLNSDocumentScannerImpl.scanEndElement(Unknown Source) at org.apache.xerces.impl.XMLDocumentFragmentScannerImpl$FragmentContentDispatcher.dispatch(Unknown Source) at org.apache.xerces.impl.XMLDocumentFragmentScannerImpl.scanDocument(Unknown Source) at org.apache.xerces.parsers.XML11Configuration.parse(Unknown Source) at org.apache.xerces.parsers.XML11Configuration.parse(Unknown Source) at org.apache.xerces.parsers.XMLParser.parse(Unknown Source) at org.apache.xerces.parsers.AbstractSAXParser.parse(Unknown Source) at org.apache.xerces.jaxp.SAXParserImpl$JAXPSAXParser.parse(Unknown Source) at org.apache.xerces.jaxp.SAXParserImpl.parse(Unknown Source) at org.apache.axis.encoding.DeserializationContext.parse(DeserializationContext.java:227) at org.apache.axis.SOAPPart.getAsSOAPEnvelope(SOAPPart.java:696) at org.apache.axis.Message.getSOAPEnvelope(Message.java:435) at org.apache.axis.transport.http.HTTPSender.readFromSocket(HTTPSender.java:796) at org.apache.axis.transport.http.HTTPSender.invoke(HTTPSender.java:144) at org.apache.axis.strategies.InvocationStrategy.visit(InvocationStrategy.java:32) at org.apache.axis.SimpleChain.doVisiting(SimpleChain.java:118) at org.apache.axis.SimpleChain.invoke(SimpleChain.java:83) at org.apache.axis.client.AxisClient.invoke(AxisClient.java:165) at org.apache.axis.client.Call.invokeEngine(Call.java:2784) at org.apache.axis.client.Call.invoke(Call.java:2767) at org.apache.axis.client.Call.invoke(Call.java:2443) at org.apache.axis.client.Call.invoke(Call.java:2366) at org.apache.axis.client.Call.invoke(Call.java:1812) at org.talend.mdm.webservice.XtentisBindingStub.putItemArray(XtentisBindingStub.java:6666) at tui_cdm.mergeprep_part1_0_7.MergePrep_Part1.tMDMOutput_11_InProcess(MergePrep_Part1.java:40856) at tui_cdm.mergeprep_part1_0_7.MergePrep_Part1$1ThreadXMLField_tMDMOutput_11_Out.run(MergePrep_Part1.java:12594) {}hostname:uktmjs03 null; nested exception is:ÃÂ java.lang.RuntimeException: java.util.ConcurrentModificationException at org.apache.axis.message.SOAPFaultBuilder.createFault(SOAPFaultBuilder.java:222) at org.apache.axis.message.SOAPFaultBuilder.endElement(SOAPFaultBuilder.java:129) at org.apache.axis.encoding.DeserializationContext.endElement(DeserializationContext.java:1087) at org.apache.xerces.parsers.AbstractSAXParser.endElement(Unknown Source) at org.apache.xerces.impl.XMLNSDocumentScannerImpl.scanEndElement(Unknown Source) at org.apache.xerces.impl.XMLDocumentFragmentScannerImpl$FragmentContentDispatcher.dispatch(Unknown Source) at org.apache.xerces.impl.XMLDocumentFragmentScannerImpl.scanDocument(Unknown Source) at org.apache.xerces.parsers.XML11Configuration.parse(Unknown Source) at org.apache.xerces.parsers.XML11Configuration.parse(Unknown Source) at org.apache.xerces.parsers.XMLParser.parse(Unknown Source) at org.apache.xerces.parsers.AbstractSAXParser.parse(Unknown Source) at org.apache.xerces.jaxp.SAXParserImpl$JAXPSAXParser.parse(Unknown Source) at org.apache.xerces.jaxp.SAXParserImpl.parse(Unknown Source) at org.apache.axis.encoding.DeserializationContext.parse(DeserializationContext.java:227) at org.apache.axis.SOAPPart.getAsSOAPEnvelope(SOAPPart.java:696) at org.apache.axis.Message.getSOAPEnvelope(Message.java:435) at org.apache.axis.transport.http.HTTPSender.readFromSocket(HTTPSender.java:796) at org.apache.axis.transport.http.HTTPSender.invoke(HTTPSender.java:144) at org.apache.axis.strategies.InvocationStrategy.visit(InvocationStrategy.java:32) at org.apache.axis.SimpleChain.doVisiting(SimpleChain.java:118) at org.apache.axis.SimpleChain.invoke(SimpleChain.java:83) at org.apache.axis.client.AxisClient.invoke(AxisClient.java:165) at org.apache.axis.client.Call.invokeEngine(Call.java:2784) at org.apache.axis.client.Call.invoke(Call.java:2767) at org.apache.axis.client.Call.invoke(Call.java:2443) at org.apache.axis.client.Call.invoke(Call.java:2366) at org.apache.axis.client.Call.invoke(Call.java:1812) at org.talend.mdm.webservice.XtentisBindingStub.putItemArray(XtentisBindingStub.java:6666) at tui_cdm.mergeprep_part1_0_7.MergePrep_Part1.tMDMOutput_11_InProcess(MergePrep_Part1.java:40856) at tui_cdm.mergeprep_part1_0_7.MergePrep_Part1$1ThreadXMLField_tMDMOutput_11_Out.run(MergePrep_Part1.java:12594) [statistics] disconnected Exception in component tRunJob_1 java.lang.RuntimeException: Child job running failed at tui_cdm.automerge_part3_0_1.AutoMerge_Part3.tRunJob_1Process(AutoMerge_Part3.java:3624) at tui_cdm.automerge_part3_0_1.AutoMerge_Part3.tJava_1Process(AutoMerge_Part3.java:3506) at tui_cdm.automerge_part3_0_1.AutoMerge_Part3.runJobInTOS(AutoMerge_Part3.java:8620) at tui_cdm.automerge_part3_0_1.AutoMerge_Part3.main(AutoMerge_Part3.java:7388)
ConcurrentModificationException in Talend Job - by Tamil Mynthan
Write embedded array fields to MongoDB - by living_jordi
I've an entity on my MongoDB like:
[code]{ÃÂ "user": "user1",
ÃÂ "password": "password",
ÃÂ "clients": ["client1", "client2", "client3"]
}[/code]
I've created a tRowGenerator component in order to generate data for {user, password} schema.
By other hand, I've created another tRowGenerator for creating dummy client codes.
Any ideas?
Accidently deleted .items and .properties , can we recover - by rhall_2.0
I am afraid not. Once the .item and .properties files are gone, the Talend job design is gone.
Loop on columns - by rhall_2.0
OK, there are two stages to this. 1) Use a tMap to to test each Folder column for an X. If it contains an X, concatenate the Form value with the Folder value. If there is more than 1 X in the row, then concatenate the concatenated values using a separator (I will use a pipe "|"). Like below.... From.... Form ÃÂ ÃÂ ÃÂ Folder1 ÃÂ ÃÂ Folder2 ÃÂ ÃÂ ÃÂ Folder3 Form1 ÃÂ X Form2 ÃÂ X ÃÂ ÃÂ ÃÂ ÃÂ ÃÂ ÃÂ ÃÂ X ÃÂ ÃÂ ÃÂ ÃÂ ÃÂ ÃÂ X Form3 ÃÂ ÃÂ ÃÂ ÃÂ ÃÂ ÃÂ ÃÂ ÃÂ ÃÂ ÃÂ X ÃÂ ÃÂ ÃÂ ÃÂ ÃÂ ÃÂ X To....... Form1Folder1 Form2Folder1|Form2Folder2|Form2Folder3 Form2Folder2|Form2Folder3 2) Next you need to create multiple rows out of the concatenated values. Use the tNormalize component for this. This is explained here ([url]https://help.talend.com/pages/viewpage.action?pageId=8123245[/url]). You will need to use pipe "|" as the separator in this example. This will return.... Form1Folder1 Form2Folder1 Form2Folder2 Form2Folder3 Form2Folder2 Form2Folder3 ÃÂ
tXMLMap not supporting some XPath expressions? - by rhall_2.0
You are making this more complicated than it needs be. You do not need to use an XPath query for this. Your available attributes on your row1 dataset are prefixed with @. Just drag them to the other side. If you really want to use XPath queries to extract your data, maybe try using the tExtractXMLField component ([url]https://help.talend.com/display/TalendOpenStudioComponentsReferenceGuide521EN/22.4+tExtractXMLField[/url]). This is what I use to deal with more complicated XML structures.
Slow uploading speed to Vertica - by woot
[quote from =nkrupa]Vertica likes to load rows in bulk. That said, what is your configuration for the tVerticaOutput component (Advanced settings)? There could be other factors at play, such as network speed. See Vertica Tips and Techniques for TalendThank you very much! The problem is resolved by the clicking checkbox on "Use batch mode". In my last version of Talend wasn't this checkbox
set up a log for dynamic db connection - by roy123
Hi I'm trying to set up dynamic mssql server conection. Here is my jobÃÂ tfixedflowinput schema host username password db port Parent Job tfixedflowinput----->tflowtoiterate-----iterate----->trunjob Child Job tmsslqconnection In tfixedflowinput I have different mssql db details and unchecked the option on die on error from trunjob as well. But I want to set a trail where I could find out if for any reason any db connection don't happen their details should be stored somewhere. So that I would be able to know that which db connection was not connected during job. Any ideas how can I set up this ?
Convert mysql table in pdf file - by erryco
hi i'm new in talendÃÂ i'd like to know is possible to convert mysql table in pdf fileÃÂ itÃÂ is possible?, if is possible how? i tried to use tjasperoutput, but in talend 6.1 i must install feature, and the feature, doesn't exist thaksÃÂ and sorry for my bad englishÃÂ
File Aggregation - by ad2009
Hi Team, I have the below sample dataÃÂ ID;NAme;Age:City 1;Ayan;11;AAA 2;Sam;22;BBB 3;AYAN;33;CCC i need the data output like below ColumnName;value;Frequency ID;1;1 ID;2;1 ............ Name;Ayan;2 Name;Sam;1 Source data is in Hive Table; I am currently using ÃÂ a PIG script which is separtely grouping the table column wise and then finding the count of each value in the column.the number of column is 470.So i am looking for an easier way to this in Talend. How to achieve the above requirement with PIG component in Talend.
variable input for tSAPInput - by Sylvain_D
Hello,
I'm trying to extract some data from SAP with tSAPInput, using function RFC_READ_TABLE.
I want to select the entries from table VBAP for a list of Materials.
The list of materials is stored in an SQL Server table, and I wrote a query giving me directly the right syntax for tSAPInput.
The output of the query looks like: "MATNR = 'A' OR" , "MATNR = 'B' OR" , "MATNR = 'C' "
I pass this to tSAPinput with tFlowIterate.
My problem is that this input doesn't seem to be taken in account by tSAPInput: VBAP entries are indeed extracted, but selection on MATNR is not done...
ÃÂ ÃÂ ÃÂ ÃÂ ÃÂ ÃÂ ÃÂ ÃÂ ÃÂ ÃÂ ÃÂ ÃÂ ÃÂ ÃÂ ÃÂ ÃÂ ÃÂ ÃÂ ÃÂ ÃÂ ÃÂ ÃÂ ÃÂ ÃÂ ÃÂ ÃÂ ÃÂ ÃÂ ÃÂ ÃÂ ÃÂ ÃÂ ÃÂ ÃÂ ÃÂ ÃÂ ÃÂ ÃÂ ÃÂ ÃÂ ÃÂ ÃÂ ÃÂ ÃÂ ÃÂ ÃÂ ÃÂ ÃÂ
So my question is: how to pass the result of my SQL Query to tSAPInput?
Thank you,
Sylvain
cCXFRS using NTLM authentication - by jnerat
Hi, I am using TOS for ESB v 6.1.1. I would like to use cCXFRS to connect to a Sharepoint 2013 server. For that, I need to authenticate using NTLM, how can I do that ? Custom component, other ?ÃÂ Thanks.
Text, Table - by Ivan12
Hello, how can I use on right side Text and Table functions? I cant figure out hot to activate functions in these fields.. I mean how I can select a table? thank you
Loop on columns - by rhall_2.0
As an example, lets assume that you have columns "One", "Two", "Three" and "Four". You want to know if these columns hold any data. If they do, then use them in a String concatenation, if they don't then ignore them. You could achieve this using a tMap variable (the box inbetween the input and output). The code you would use would be something like this (assuming the input row is "row1" and a pipe "|" will be used as a separator).... [code](row1.One!=null ? row1.One +"|" : "") + (row1.Two!=null ? row1.Two +"|" : "") + (row1.Three!=null ? row1.Three +"|" : "") + (row1.Four!=null ? row1.Four +"|" : "")[/code] Then the variable you create is used to pass the resulting value to the output column. The above example will do this to the following data.... One ÃÂ ÃÂ Two ÃÂ ÃÂ Three ÃÂ ÃÂ Four a ÃÂ ÃÂ ÃÂ ÃÂ ÃÂ ÃÂ ÃÂ ÃÂ c ÃÂ ÃÂ ÃÂ ÃÂ ÃÂ b ÃÂ ÃÂ ÃÂ ÃÂ ÃÂ ÃÂ ÃÂ ÃÂ ÃÂ ÃÂ d a ÃÂ ÃÂ ÃÂ b ÃÂ ÃÂ ÃÂ ÃÂ c ÃÂ ÃÂ ÃÂ ÃÂ ÃÂ d Result a|c| b|d| a|b|c|d| (Obviously some code would be need to remove the trailing pipe in this example)
Exception handling with JSON column names - by bbrooksux
Hi Amol, Sorry about the initial bad JSON in the original post. I've been working on some other malformed JSON testing and I guess I grabbed the wrong line!ÃÂ :DÃÂ That said, we are able to capture malformed JSON (such as this) with the simple rejection path within Talend (see screenshot). What this rejection path doesn't capture is the scenario where the naming structure changes (expecting "solution" for column name and get "solutionJJ"). The formatting of the JSON is correct, but the extraction breaks down because it does not see the proper column name. Does this help?ÃÂ https://www.talendforge.org/forum/img/members/293953/rejection.jpgÃÂ [/url]
Comparing csv files with more no. of columns - by rhall_2.0
What exactly are you comparing and why? There are ways to make comparisons and mappings less tedious, but you have to consider the tool to be "dumb". It is not going to know what you want and the most you will get out of mapping functionality is for ÃÂ it to automatically columns that are named the same.....and that is as it should be.ÃÂ If you take a screenshot of your current mapping (I am assuming you are using a tMap) with some explanation as to why and what you want to achieve, we may be able to suggest better ways of doing this.
tFileExcelWorkbookOpen Java heap space error - by morganspice21
[size=1][font=Verdana, Helvetica, Arial, sans-serif]Hi There,[/font][/size] [size=1][font=Verdana, Helvetica, Arial, sans-serif]I am using the custom components tFileWorkbookOpen, tFileExcelSheetList, tFileExcelSheetInput ÃÂ to read in large excel (xlsx) files each is roughly 16kb - 30mb. I keep getting the java heap space error (out of memory) when the file is more than 1mb. I have tried increasing the heap space to a staggering 10gigs but it still does not solve it.[/font][/size] [size=1][font=Verdana, Helvetica, Arial, sans-serif]I'm now trying to read in a sheet at a time and save to.csv but the component will not write anything to the csv file as it bombs out with memory error. I have stripped my job down to the bare minimum (see screenshot) to try and get the component to work but still no luck![/font][/size] [size=1][font=Verdana, Helvetica, Arial, sans-serif]I am using Talend Open Studio for Data Integration version 5.6, would the newest version of TOS be able to process it?[/font][/size] [size=1][font=Verdana, Helvetica, Arial, sans-serif]Anyones advice and guidance will be very much appreciated.[/font][/size]
Sent an email with error - by dan_netto
Hi guys. I've a problem, I need to send an email with error,ÃÂ but when my subjob finish with error, the component tSendEmail abort due to thisÃÂ error. I want to take the error in console, print in my email and sent doesn't matter the status of job(I'm unchecked the option "Die on Child Error").ÃÂ I've had tried with tStatCatcher and tLogRow but didn't works for me. If you have something to help-me I'll appreciate that. Thank's a lot. Daniel Netto.
Apply 'Preparation' recipies to a new file - by mertez
jlolling: Yes, yesterday it took me quite a lot of time but at least I have learned how to use it :) ctoum: Perfect, thanks. The tool seems really promising.
??? Salesforce - Empty RecycleBin by Job TALEND ???? - by atalent
Hi, I'm going to develop a job between SAP system and CRM Salesforce. In this interface, I need to empty RecycleBin Salesforce but I don't find component to do realize this action. I found an component to get record in RecycleBin but I couldn't delete them. Do you know How it is possible to empty RecycleBin? Thank in advance Anthony
range search in tmap expression - by yugandhar9
Hi, I have the below logic and trying to implement in Talend tmap expression. Can anyone please let me know on the below approach. f the zip code is 12345, try to find a valid zip code within the range 12340 and 12349. If none are found, next try using a range of 12300 and 12399. If still none are found, next try using a range of 12000 and 12999, If still none are found, next try a range of 10000 and 19999 Thanks!