Hello, I would be good to be able to drag & drop a file in Talend Data Preparation to open it.
Drag & drop to open a file - by benoit_BCA
How to edit the rules and the editing work flow - by jfranco
Hi I suggest you install the generally available release no that it is on Talend's web site. On the download page, if you scroll down, you will also see links to a getting started guide, documentation, etc. Regards
tXMLMap: Use of a variable to Rename a Tree Node - by rhall_2.0
The easiest way to do this is to produce the XML in the tXMLMap, convert it to a String using the tConvertType, do a find and replace using Java String methods, convert the resulting String back into an XML Document using the tConvertType. Yes it sounds cumbersome, but is actually really easy to implement and fills the gap you have spotted here.
Can uploaded Talend Desktop cleanup mixed data - by jfranco
Hi James
Some functionalities will help you to to that like the type auto-recognition option, or the patterns in the vizualisation box
ÃÂ
1st line of file is not header - by jfranco
Hi Benoit Mark as header is one of the functions provided for lines (see screenshot)
cMessagingEndpoint and RabbitMQ (ESB Mediation) - by ORo
Dear all, I'd like to read messages from RabbitMQ. For that I've done the following: [list=1] [*]I created a new route[/*] [*]I added a cMessagingEndpoint on the "job" with "rabbitmq" in Advanced Settings and the following URI:ÃÂ "rabbitmq://127.0.0.1:5672/myExchangeName?queue=myQueue"[/*] [*]with the assumption to read messages I added cLog as well and added a route from cMessagingEndpoint to cLog[/*] [*]I started the job[/*] [*]on RabbitMQ Management Console I inserted a new message to the respective exchange "myExchangeName" and the message ended in the queue "myQueue"[/*] [/list] The problem. Nothing happens. The message is still in the queue. cLog doesn't show anything. What did I do wrong? Kind regards, ORo
set up a log for dynamic db connection - by roy123
any ?
tXMLMap not supporting some XPath expressions? - by rhall_2.0
You have to understand that XML is a hierarchical data structure which can be loosely equated to a small set of related RDBMS tables. As such, you can get multiple flattened rows from a single file. You might want to restrict the "rows" that get to the output using the variables or the output filter that I mentioned previously. But if you simply want to get the value of an element based on its attribute value, this can be done by using the attribute and the element with a tXMLMap variable.ÃÂ I sense that you are probably a Java developer that is new to Talend. If this is the case, at first Talend can seem a bit counter intuitive. However, there is method in what first appears to be madness. The biggest mistake made by people who know Java and are new to Talend is "recreating the wheel". Using Talend to trigger bespoke Java code. There is nothing wrong with writing your own code and making use of third party APIs (that is one of the things that makes Talend great in my eyes), just be careful not to "recreate the wheel". Good luck.
File size - by brian_indy
I am trying to run some CSV data through the tool and it keeps crashing at the end of the adding dataset process. ÃÂ The file itself is about 2.8GB, which is what I may end up dealing with if I pull from an HDFS datastore. ÃÂ Is there a maximum file size that the tool can ingest and is there a way to tune the Java stack?
Oracle db copy - by jlolling
Hi, I am sorry but I guess this will not work because dealing with Oracle BLOBs is a bit more complex than what the component provides. I will check if I can this capability.
if and else condition in tmap expression - by yugandhar9
Thank you Amol!It worked
Difference between Standard jobs and Big Data jobs in Talend - by jholman
ÃÂ ÃÂ ÃÂ The images you provided appear identical (both labeled Standard Job) so I'm not entirely sure of the differences, so I will summarize the current type of jobs as of 6.1.1 as I understand them: 1. Standard - This is just a java process. It can access many data sources via JDBC or HDFS,etc but the main process just executes in a JVM.ÃÂ 2. BigData Streaming - This is for realtime-ish/microbatch stuff, the jobs are sent to Spark or Storm for execution.ÃÂ 3. BigData Batch - Uses either MR1(namenode,etc)/YARN for MapReduce execution, or Spark for execution (With or without YARN depending on platform) Hope that helps! P.S. Imapla is it's own thing, so I would expect that part to behave about the same if on the same hardware.ÃÂ
Connect to Impala with LDAP authentication - by jholman
It should be fairly trivial to edit the tImapalaConnection template (look in ${TALEND_HOME}/plugins/org.talend.designer.components.bigdata_${VERSION}/components) and add an additional dropdown "AuthMec" to the component and remove the 'noSasl' string. See if you can find a tutorial likeÃÂ http://www.talendforge.org/wiki/doku.php?id=doc:component_creation_example_java to show you how to edit a component.ÃÂ
How to export a Job from Talend Studio in XML format? - by jholman
I would suggest trying to use a bulkloader that works as long as the source file fits the destination table. This way you can loop over a set of tables and dump them using a dynamic schema to write the files, and then bulk load them even if they have different schemas as long as they fit the target (this depends on what database you are using but for MSSQL "bcp" will work, or "nzload" for Netezza, etc)ÃÂ
Schema Import does not pull the DBType - by nkrupa
Manmeet, Do I understand correctly that you're trying to apply a Postgres schema for a tHiveCreateTable component? Could you also share a screenshot of your job and output of the error?
Read multiple excel files - by vital_parsley
Hi , Could anyone please let me know how can I design a job where I am reading from multiple excel files and loading it to a database. I could create separate jobs each having its own texcelfileread ----> tMap --> tOracle texcelfileread ----> tMap --> tOracle texcelfileread ----> tMap --> tOracle so on... But I would like to design in the below way or any other efficient way that you can suggest : texcelfileread ----\ texcelfileread ----> tMap --> tOracle texcelfileread ---/ So here I collect all the data from 3 excel files first then apply any transformations any then load it to tOracle component. Kindly let know your suggestions asap.
Transforming three dimensional tabular data to XML - by needtalend
Hi Amol, thanks again for your response. I tried your example, but I am not able to join the "emps" and "printers" child nodes in the tExtractXMLField with the destination "dept" schema in tFileOutputXml (replaced tLogRow_5) as the "emps" and "printers" nodes are grayed out(disabled) in tFileOutputXml. Are the Xpaths you mentioned in tExtractXMLField for "emps" and "printers" are correct? I would think, the "emps" and "printers" nodes in tFileOutputXML and the ones in tExtractXMLField are of the same structure, right? ÃÂ A screenshot of "emps" and "printers" nodes mapping would help me. Thanks again.
NULL data flowing out of tMAP - by vital_parsley
Hi Team, Could you please help me debug my issue here. I have an excel file which i m reading through tFileInputExcel and passing it to a tMAP to tConvertType to tOracleOutput. When the data flows out of tMap component it is all null.Can you help me figure out the reason.I have all the required fields. below is the representation : tFileInputExcel --> tMAP --> tConvertType -->ÃÂ tOracleOutput tFileInputExcel - has 5 fields all string types tMAP - has 9 feilds all String types with different field names (Here a mapping is done correctly) tConverTye - has 20 fields in out of different datatypes tOracleOutput - has metadata same as tConverTye out. But when the data is flowing out of tMAP it is only showing null values for all fields. Could you help em out urgently. Let me know if more information is required.
We are looking WEB PUBLISHER - by dctmedia
We are looking web publisher(international). This website media is an award-wining, innovative global performance marketing network featuring numerous publisher tools, including Content Lockers and the first ever Product Locker. There 2,500 + incent/non-incent offer base is comprised of top convertingÃÂ campaigns across a variety of niches. If you are interested just send us an email.... EMAIL SUBJECT LINE: ÃÂ WEB PUBLISHER - 71281 SEND TO: ÃÂ weissdennis45@yahoo.comÃÂ
java.lang.NoClassDefFoundError: Integer - by khenderson_Volo
I am also having this same issue. My code is simply attempting to rename a file on an FTP server. The issue remains after reinstalling Talend I am using:ÃÂ Windows 10 Pro JDK 8_73 C:\Talend\TOS_DI-20151214_1327-V6.1.1 java.lang.NoClassDefFoundError: Integer at java.lang.Class.getDeclaredMethods0(Native Method) at java.lang.Class.privateGetDeclaredMethods(Unknown Source) at java.lang.Class.privateGetMethodRecursive(Unknown Source) at java.lang.Class.getMethod0(Unknown Source) at java.lang.Class.getMethod(Unknown Source) at sun.launcher.LauncherHelper.validateMainClass(Unknown Source) at sun.launcher.LauncherHelper.checkAndLoadMain(Unknown Source) Caused by: java.lang.ClassNotFoundException: Integer at java.net.URLClassLoader.findClass(Unknown Source) at java.lang.ClassLoader.loadClass(Unknown Source) at sun.misc.Launcher$AppClassLoader.loadClass(Unknown Source) at java.lang.ClassLoader.loadClass(Unknown Source) ... 7 more Error: A JNI error has occurred, please check your installation and try again Exception in thread "main"ÃÂ Job FTPFileRename ended at 07:38 13/02/2016. [exit code=1]