In tFileFetch select the Use cache to save the resource check box to add your file data to the cache memory. This option allows you to use the streaming mode to transfer the data. In this case you don’t need provide destination filename and location. You can use ((java.io.InputStream)globalMap.get("tFileFetch_1_INPUT_STREAM")) variable to access the file data.
For example, my tFileInputDelimited component uses a tFileFetch as its source and the File name/Stream field looks like this. Similar way use can use for any file format such as XML, JSON.
((java.io.InputStream)globalMap.get("tFileFetch_1_INPUT_STREAM"))
((java.io.InputStream)globalMap.get("tFileFetch_1_INPUT_STREAM"))
Cheers!
Uma
Uma
I have a folder with 10 csv files. how can I read them one by one and get them uploaded to data lake using tFileFetch component
ReplyDelete