Quantcast
Channel: New Topics on Talend Community Forum
Viewing all 2816 articles
Browse latest View live
↧

ConcurrentModificationException in Talend Job - by Tamil Mynthan

February 12, 2016, 12:09 am
$
0
0

Hi Talend team, We are getting the same 'ConcurrentModificationException' issue in tMDMoutput component while running our job from TAC, we are using talend 5.2.2 version (Talend Platform for MDM).   we are sending 11185 rows to tMDMoutput component. is this the reason for this failure ? Thanks in advance. My error message: AutoMerge Part3 has been started Exception in component tMDMOutput_11_In AxisFault  faultCode: {}Server  faultSubcode:   faultString: null; nested exception is:  java.lang.RuntimeException: java.util.ConcurrentModificationException  faultActor:   faultNode:   faultDetail:  {}stackTrace:null; nested exception is:  java.lang.RuntimeException: java.util.ConcurrentModificationException at org.apache.axis.message.SOAPFaultBuilder.createFault(SOAPFaultBuilder.java:222) at org.apache.axis.message.SOAPFaultBuilder.endElement(SOAPFaultBuilder.java:129) at org.apache.axis.encoding.DeserializationContext.endElement(DeserializationContext.java:1087) at org.apache.xerces.parsers.AbstractSAXParser.endElement(Unknown Source) at org.apache.xerces.impl.XMLNSDocumentScannerImpl.scanEndElement(Unknown Source) at org.apache.xerces.impl.XMLDocumentFragmentScannerImpl$FragmentContentDispatcher.dispatch(Unknown Source) at org.apache.xerces.impl.XMLDocumentFragmentScannerImpl.scanDocument(Unknown Source) at org.apache.xerces.parsers.XML11Configuration.parse(Unknown Source) at org.apache.xerces.parsers.XML11Configuration.parse(Unknown Source) at org.apache.xerces.parsers.XMLParser.parse(Unknown Source) at org.apache.xerces.parsers.AbstractSAXParser.parse(Unknown Source) at org.apache.xerces.jaxp.SAXParserImpl$JAXPSAXParser.parse(Unknown Source) at org.apache.xerces.jaxp.SAXParserImpl.parse(Unknown Source) at org.apache.axis.encoding.DeserializationContext.parse(DeserializationContext.java:227) at org.apache.axis.SOAPPart.getAsSOAPEnvelope(SOAPPart.java:696) at org.apache.axis.Message.getSOAPEnvelope(Message.java:435) at org.apache.axis.transport.http.HTTPSender.readFromSocket(HTTPSender.java:796) at org.apache.axis.transport.http.HTTPSender.invoke(HTTPSender.java:144) at org.apache.axis.strategies.InvocationStrategy.visit(InvocationStrategy.java:32) at org.apache.axis.SimpleChain.doVisiting(SimpleChain.java:118) at org.apache.axis.SimpleChain.invoke(SimpleChain.java:83) at org.apache.axis.client.AxisClient.invoke(AxisClient.java:165) at org.apache.axis.client.Call.invokeEngine(Call.java:2784) at org.apache.axis.client.Call.invoke(Call.java:2767) at org.apache.axis.client.Call.invoke(Call.java:2443) at org.apache.axis.client.Call.invoke(Call.java:2366) at org.apache.axis.client.Call.invoke(Call.java:1812) at org.talend.mdm.webservice.XtentisBindingStub.putItemArray(XtentisBindingStub.java:6666) at tui_cdm.mergeprep_part1_0_7.MergePrep_Part1.tMDMOutput_11_InProcess(MergePrep_Part1.java:40856) at tui_cdm.mergeprep_part1_0_7.MergePrep_Part1$1ThreadXMLField_tMDMOutput_11_Out.run(MergePrep_Part1.java:12594) {}hostname:uktmjs03 null; nested exception is:  java.lang.RuntimeException: java.util.ConcurrentModificationException at org.apache.axis.message.SOAPFaultBuilder.createFault(SOAPFaultBuilder.java:222) at org.apache.axis.message.SOAPFaultBuilder.endElement(SOAPFaultBuilder.java:129) at org.apache.axis.encoding.DeserializationContext.endElement(DeserializationContext.java:1087) at org.apache.xerces.parsers.AbstractSAXParser.endElement(Unknown Source) at org.apache.xerces.impl.XMLNSDocumentScannerImpl.scanEndElement(Unknown Source) at org.apache.xerces.impl.XMLDocumentFragmentScannerImpl$FragmentContentDispatcher.dispatch(Unknown Source) at org.apache.xerces.impl.XMLDocumentFragmentScannerImpl.scanDocument(Unknown Source) at org.apache.xerces.parsers.XML11Configuration.parse(Unknown Source) at org.apache.xerces.parsers.XML11Configuration.parse(Unknown Source) at org.apache.xerces.parsers.XMLParser.parse(Unknown Source) at org.apache.xerces.parsers.AbstractSAXParser.parse(Unknown Source) at org.apache.xerces.jaxp.SAXParserImpl$JAXPSAXParser.parse(Unknown Source) at org.apache.xerces.jaxp.SAXParserImpl.parse(Unknown Source) at org.apache.axis.encoding.DeserializationContext.parse(DeserializationContext.java:227) at org.apache.axis.SOAPPart.getAsSOAPEnvelope(SOAPPart.java:696) at org.apache.axis.Message.getSOAPEnvelope(Message.java:435) at org.apache.axis.transport.http.HTTPSender.readFromSocket(HTTPSender.java:796) at org.apache.axis.transport.http.HTTPSender.invoke(HTTPSender.java:144) at org.apache.axis.strategies.InvocationStrategy.visit(InvocationStrategy.java:32) at org.apache.axis.SimpleChain.doVisiting(SimpleChain.java:118) at org.apache.axis.SimpleChain.invoke(SimpleChain.java:83) at org.apache.axis.client.AxisClient.invoke(AxisClient.java:165) at org.apache.axis.client.Call.invokeEngine(Call.java:2784) at org.apache.axis.client.Call.invoke(Call.java:2767) at org.apache.axis.client.Call.invoke(Call.java:2443) at org.apache.axis.client.Call.invoke(Call.java:2366) at org.apache.axis.client.Call.invoke(Call.java:1812) at org.talend.mdm.webservice.XtentisBindingStub.putItemArray(XtentisBindingStub.java:6666) at tui_cdm.mergeprep_part1_0_7.MergePrep_Part1.tMDMOutput_11_InProcess(MergePrep_Part1.java:40856) at tui_cdm.mergeprep_part1_0_7.MergePrep_Part1$1ThreadXMLField_tMDMOutput_11_Out.run(MergePrep_Part1.java:12594) [statistics] disconnected Exception in component tRunJob_1 java.lang.RuntimeException: Child job running failed at tui_cdm.automerge_part3_0_1.AutoMerge_Part3.tRunJob_1Process(AutoMerge_Part3.java:3624) at tui_cdm.automerge_part3_0_1.AutoMerge_Part3.tJava_1Process(AutoMerge_Part3.java:3506) at tui_cdm.automerge_part3_0_1.AutoMerge_Part3.runJobInTOS(AutoMerge_Part3.java:8620) at tui_cdm.automerge_part3_0_1.AutoMerge_Part3.main(AutoMerge_Part3.java:7388)

↧
Search

Write embedded array fields to MongoDB - by living_jordi

February 12, 2016, 12:29 am
$
0
0

I've an entity on my MongoDB like: [code]{  "user": "user1",   "password": "password",   "clients": ["client1", "client2", "client3"] }[/code] I've created a tRowGenerator component in order to generate data for {user, password} schema. By other hand, I've created another tRowGenerator for creating dummy client codes. Any ideas?

↧
↧

Accidently deleted .items and .properties , can we recover - by rhall_2.0

February 12, 2016, 1:50 am
$
0
0

I am afraid not. Once the .item and .properties files are gone, the Talend job design is gone.

↧

Loop on columns - by rhall_2.0

February 12, 2016, 2:03 am
$
0
0

OK, there are two stages to this. 1) Use a tMap to to test each Folder column for an X. If it contains an X, concatenate the Form value with the Folder value. If there is more than 1 X in the row, then concatenate the concatenated values using a separator (I will use a pipe "|"). Like below.... From.... Form     Folder1     Folder2      Folder3 Form1   X Form2   X               X             X Form3                    X             X To....... Form1Folder1 Form2Folder1|Form2Folder2|Form2Folder3 Form2Folder2|Form2Folder3 2) Next you need to create multiple rows out of the concatenated values. Use the tNormalize component for this. This is explained here ([url]https://help.talend.com/pages/viewpage.action?pageId=8123245[/url]). You will need to use pipe "|" as the separator in this example. This will return.... Form1Folder1 Form2Folder1 Form2Folder2 Form2Folder3 Form2Folder2 Form2Folder3  

↧

tXMLMap not supporting some XPath expressions? - by rhall_2.0

February 12, 2016, 2:16 am
$
0
0

You are making this more complicated than it needs be. You do not need to use an XPath query for this. Your available attributes on your row1 dataset are prefixed with @. Just drag them to the other side. If you really want to use XPath queries to extract your data, maybe try using the tExtractXMLField component ([url]https://help.talend.com/display/TalendOpenStudioComponentsReferenceGuide521EN/22.4+tExtractXMLField[/url]). This is what I use to deal with more complicated XML structures.

↧
↧

Slow uploading speed to Vertica - by woot

February 12, 2016, 2:41 am
$
0
0

[quote from =nkrupa]Vertica likes to load rows in bulk. That said, what is your configuration for the tVerticaOutput component (Advanced settings)? There could be other factors at play, such as network speed. See Vertica Tips and Techniques for Talend
Thank you very much! The problem is resolved by the clicking checkbox on "Use batch mode". In my last version of Talend wasn't this checkbox
↧

set up a log for dynamic db connection - by roy123

February 12, 2016, 3:19 am
$
0
0

Hi I'm trying to set up dynamic mssql server conection. Here is my job  tfixedflowinput schema host username password db port Parent Job tfixedflowinput----->tflowtoiterate-----iterate----->trunjob Child Job tmsslqconnection In tfixedflowinput I have different mssql db details and unchecked the option on die on error from trunjob as well. But I want to set a trail where I could find out if for any reason any db connection don't happen their details should be stored somewhere. So that I would be able to know that which db connection was not connected during job. Any ideas how can I set up this ?

↧

Convert mysql table in pdf file - by erryco

February 12, 2016, 3:45 am
$
0
0

hi i'm new in talend  i'd like to know is possible to convert mysql table in pdf file  it is possible?, if is possible how? i tried to use tjasperoutput, but in talend 6.1 i must install feature, and the feature, doesn't exist thaks  and sorry for my bad english 

↧
Search

File Aggregation - by ad2009

February 12, 2016, 4:45 am
$
0
0

Hi Team, I have the below sample data  ID;NAme;Age:City 1;Ayan;11;AAA 2;Sam;22;BBB 3;AYAN;33;CCC i need the data output like below ColumnName;value;Frequency ID;1;1 ID;2;1 ............ Name;Ayan;2 Name;Sam;1 Source data is in Hive Table; I am currently using  a PIG script which is separtely grouping the table column wise and then finding the count of each value in the column.the number of column is 470.So i am looking for an easier way to this in Talend. How to achieve the above requirement with PIG component in Talend.

↧
↧

variable input for tSAPInput - by Sylvain_D

February 12, 2016, 5:30 am
$
0
0

Hello, I'm trying to extract some data from SAP with tSAPInput, using function RFC_READ_TABLE. I want to select the entries from table VBAP for a list of Materials.

The list of materials is stored in an SQL Server table, and I wrote a query giving me directly the right syntax for tSAPInput. The output of the query looks like: "MATNR = 'A' OR" , "MATNR = 'B' OR" , "MATNR = 'C' " I pass this to tSAPinput with tFlowIterate.

My problem is that this input doesn't seem to be taken in account by tSAPInput: VBAP entries are indeed extracted, but selection on MATNR is not done...                                                  So my question is: how to pass the result of my SQL Query to tSAPInput? Thank you, Sylvain

↧

cCXFRS using NTLM authentication - by jnerat

February 12, 2016, 5:53 am
$
0
0

Hi, I am using TOS for ESB v 6.1.1. I would like to use cCXFRS to connect to a Sharepoint 2013 server. For that, I need to authenticate using NTLM, how can I do that ? Custom component, other ?  Thanks.

↧

Text, Table - by Ivan12

February 12, 2016, 5:53 am
$
0
0

Hello, how can I use on right side Text and Table functions? I cant figure out hot to activate functions in these fields.. I mean how I can select a table? thank you

↧

Loop on columns - by rhall_2.0

February 12, 2016, 7:00 am
$
0
0

As an example, lets assume that you have columns "One", "Two", "Three" and "Four". You want to know if these columns hold any data. If they do, then use them in a String concatenation, if they don't then ignore them. You could achieve this using a tMap variable (the box inbetween the input and output). The code you would use would be something like this (assuming the input row is "row1" and a pipe "|" will be used as a separator).... [code](row1.One!=null ? row1.One +"|" : "") + (row1.Two!=null ? row1.Two +"|" : "") + (row1.Three!=null ? row1.Three +"|" : "") + (row1.Four!=null ? row1.Four +"|" : "")[/code] Then the variable you create is used to pass the resulting value to the output column. The above example will do this to the following data.... One    Two    Three    Four a                 c          b                    d a       b        c           d Result a|c| b|d| a|b|c|d| (Obviously some code would be need to remove the trailing pipe in this example)

↧
↧

Exception handling with JSON column names - by bbrooksux

February 12, 2016, 7:10 am
$
0
0

Hi Amol, Sorry about the initial bad JSON in the original post. I've been working on some other malformed JSON testing and I guess I grabbed the wrong line! :D That said, we are able to capture malformed JSON (such as this) with the simple rejection path within Talend (see screenshot). What this rejection path doesn't capture is the scenario where the naming structure changes (expecting "solution" for column name and get "solutionJJ"). The formatting of the JSON is correct, but the extraction breaks down because it does not see the proper column name. Does this help?  https://www.talendforge.org/forum/img/members/293953/rejection.jpg [/url]

↧

Comparing csv files with more no. of columns - by rhall_2.0

February 12, 2016, 7:21 am
$
0
0

What exactly are you comparing and why? There are ways to make comparisons and mappings less tedious, but you have to consider the tool to be "dumb". It is not going to know what you want and the most you will get out of mapping functionality is for  it to automatically columns that are named the same.....and that is as it should be.  If you take a screenshot of your current mapping (I am assuming you are using a tMap) with some explanation as to why and what you want to achieve, we may be able to suggest better ways of doing this.

↧
Search

tFileExcelWorkbookOpen Java heap space error - by morganspice21

February 12, 2016, 7:23 am
$
0
0

[size=1][font=Verdana, Helvetica, Arial, sans-serif]Hi There,[/font][/size] [size=1][font=Verdana, Helvetica, Arial, sans-serif]I am using the custom components tFileWorkbookOpen, tFileExcelSheetList, tFileExcelSheetInput  to read in large excel (xlsx) files each is roughly 16kb - 30mb. I keep getting the java heap space error (out of memory) when the file is more than 1mb. I have tried increasing the heap space to a staggering 10gigs but it still does not solve it.[/font][/size] [size=1][font=Verdana, Helvetica, Arial, sans-serif]I'm now trying to read in a sheet at a time and save to.csv but the component will not write anything to the csv file as it bombs out with memory error. I have stripped my job down to the bare minimum (see screenshot) to try and get the component to work but still no luck![/font][/size] [size=1][font=Verdana, Helvetica, Arial, sans-serif]I am using Talend Open Studio for Data Integration version 5.6, would the newest version of TOS be able to process it?[/font][/size] [size=1][font=Verdana, Helvetica, Arial, sans-serif]Anyones advice and guidance will be very much appreciated.[/font][/size]

↧

Sent an email with error - by dan_netto

February 12, 2016, 7:49 am
$
0
0

Hi guys. I've a problem, I need to send an email with error, but when my subjob finish with error, the component tSendEmail abort due to this error. I want to take the error in console, print in my email and sent doesn't matter the status of job(I'm unchecked the option "Die on Child Error"). I've had tried with tStatCatcher and tLogRow but didn't works for me. If you have something to help-me I'll appreciate that. Thank's a lot. Daniel Netto.

↧
↧

Apply 'Preparation' recipies to a new file - by mertez

February 12, 2016, 7:54 am
$
0
0

jlolling: Yes, yesterday it took me quite a lot of time but at least I have learned how to use it :) ctoum: Perfect, thanks. The tool seems really promising.

↧

??? Salesforce - Empty RecycleBin by Job TALEND ???? - by atalent

February 12, 2016, 7:54 am
$
0
0

Hi, I'm going to develop a job between SAP system and CRM Salesforce. In this interface, I need to empty RecycleBin Salesforce but I don't find component to do realize this action. I found an component to get record in RecycleBin but I couldn't delete them. Do you know How it is possible to empty RecycleBin? Thank in advance Anthony

↧

range search in tmap expression - by yugandhar9

February 12, 2016, 8:12 am
$
0
0

Hi, I have the below logic and trying to implement in Talend tmap expression. Can anyone please let me know on the below approach. f the zip code is 12345, try to find a valid zip code within the range 12340 and 12349. If none are found, next try using a range of 12300 and 12399. If still none are found, next try using a range of 12000 and 12999, If still none are found, next try a range of 10000 and 19999 Thanks!

↧
Viewing all 2816 articles
Browse latest View live
Search