SFTP download Archives - My Blog My WordPress Blog Fri, 18 Aug 2023 21:47:15 +0000 en-US hourly 1 Informatica Cloud File Processor Connector https://new.infofiscus.in/cloud-data-integration/informatica-cloud-file-processor-connector/ Fri, 01 Mar 2019 04:28:31 +0000 http://www.infometryinc.com/?p=963 Problem Description-
Several times a user would want to upload and download files from the remote machine to a local machine using FTP/SFTP. As to transfer files from the Protocol system the user needs privileges along with a proper connector to transfer a file from the Informatica platform to another system or vice versa.

The post Informatica Cloud File Processor Connector appeared first on My Blog.

]]>
Problem Description-

Informatica Cloud File Processor Connector Several times a user would want to upload and download files from the remote machine to a local machine using FTP/SFTP. As to transferring files from the Protocol system the user needs privileges along with a proper connector to transfer a file from the Informatica platform to another system or vice versa.

Challenges to User/Developer-

  • The above problem can be resolved with the help of the Informatica file processor Connector.
  • The User needs to create a connection with appropriate credentials to transfer files between two platforms.
  • Need to test the connections.

Solution

Informatica Cloud File Processor Connector

Approach-

  • You can use File Processor Connector to perform the file transfer. You perform FTP and SFTP transfer to upload or download files from your remote machine to the local machine with File Processor Connector.
  • You can do encryption and decryption of files with a File processor. You can also copy, rename, move, compress, decompress, encrypt, archive, and unarchive files with File Processor Connector.
  • Informatica Connector for File Processor helps customers in managing the file system.

Technical Solution –

1) Create the Connection (This will end up being the ‘Source Connection’)

Source Connection

  • Pick your secure agent. The ‘Source File Directory’ should have a ‘/’ in front of it if you are using a sub-directory.
  • The ‘Target File Directory’ is a directory on the same server as the security agent. The ‘Select -File’ drop-down is great because you can specify all kinds of filters on what type of files to download.
  • In this screenshot, I chose ‘Select File’. I have left nothing in the File pattern so all kinds of files should be selected.
  • Relied more on the ‘Filename’ data filter in ‘Step 4’ below, but it is nice to have options.  Also, put your password in the PassKey1 field so it can be used later.

2) Create another Connection (This will end up being the ‘Target Connection’)

Connection Details

  • In the new connection that will be used for the ‘Target’, we need to specify the directory where the files should be saved.
  • The ‘Type’ drop-down should be ‘Flat File’ and the ‘Directory’ should be the directory to which the files should be copied.

3) Create the ‘Data Synchronization Task

Step 1 – Definition

Insert Operation

Give the task a name and description and then specify it as in the ‘Insert’ job.

Step 2 – Source
Select Source

In the Connection, drop-down select the ‘File Process Connector’ connection created in#1.
The ‘Source Object’ pick-list should be set to ‘SFTP_GET’.

Step 3 – Target
Informatica Cloud File Processor Connector

In the Connection, the drop-down specifies the ‘Flat File’ connector that was created in #2. The Target Object selected should be Infa_SFTP_GET.csv.

Step 4 – Data Filters
Informatica Cloud File Processor Connector
  • We need to Select to process all rows to get complete data from the source.
  • As filters are the certain conditions depend on that the connection enters to SFTP server with respective Hostname, user name, and password.
Step 5 – Field Mapping
Informatica Cloud File Processor Connector
  • The field mapping should be done for you. The Source and the Target fields are the same.
  • After the field mapping the schedule options will come to set and appropriate timing for the job to run, we can schedule or can run Manually.

Advantage –

The main Advantage of this process is that the random data can be shared from A FTP location to some other location. As SFTP is a very protective way to transfer data from one location to another.

Issues –

None

Conclusion:

Informatica Cloud File Processor Connector The file will be moved from the SFTP location to the target directory with a secure protocol.

 

The post Informatica Cloud File Processor Connector appeared first on My Blog.

]]>
Excel to CSV using SFTP In IICS https://new.infofiscus.in/blog/excel-to-csv-using-sftp/ Mon, 18 Feb 2019 08:58:43 +0000 http://www.infometryinc.com/?p=851 Problem Description

Customers/Users face issues with loading Excel files from SFTP remote server to local machine and convert the excel file to CSV file in mapping on IICS.

Challenges to User/Developer

In IICS, above-mentioned problem can be solved through Java Transformation.
The Excel file needs to be transferred to the local machine (where the secure agent is installed).
The locally available Excel file needs to be converted to CSV file.
Move the original Excel file which we got from SFTP remote server to other location.

The post Excel to CSV using SFTP In IICS appeared first on My Blog.

]]>
Problem Description

Convert Excel to CSV  Customers/Users face issues with loading Excel files from SFTP remote server to local machine and convert the excel file to CSV file in mapping on IICS.

Challenges to User/Developer

  • In IICS, the above-mentioned problem can be solved through Java Transformation.
  • The Excel file needs to be transferred to the local machine (where the security agent is installed).
  • The locally available Excel file needs to be converted to a CSV file.
  • Move the original Excel file which we got from SFTP remote server to another location.

Solution: 

Approach –

Excel to CSV using SFTP In Informatica Intelligent Cloud Services (IICS)

Convert Using Java Transformation, we can achieve the solution for the above-mentioned challenges.

Java transformation is used to add custom integration logic into mappings using a built-in developer-friendly editor or by plugging in custom JAR files.

 Technical Solution –

  • Develop Java code that performs Excel files transfer from SFTP to Local machine and converts Excel file to CSV file using IDE (ex. Eclipse)
  • Create an Executable jar file for the above-developed java code.
  • Place the above-created jar file at any directory at the local machine (where the security agent is installed).
  • Copy the above directory path including the jar name with extension.
  • Create the CLASSPATH Environment variable if not available.
  • Paste the above-copied directory to the CLASSPATH Environmental variable.
Convert Excel to CSV
  • Restart the secure agent.
  • Create the mapping using source and target with java transformation in between them.
Convert Excel to CSV
  • Edit java transformation to make a call to the specific method of the class available in a jar which is responsible for transferring the file through SFTP to Local machine and converts Excel file to CSV file.
Convert Excel to CSV
  • Compile the above java code, validate the mapping and run.

 

Advantage –

The file will get a transfer from the SFTP directory to the Local machine directory and convert from an Excel file to a CSV file.

Issues –

None

Conclusion

The excel file will now be transferred to the local machine and will be converted accordingly.

 

The post Excel to CSV using SFTP In IICS appeared first on My Blog.

]]>