2022

Page tree
Skip to end of metadata
Go to start of metadata

In this tutorial we will learn the movement of file, files and directory, within Amazon S3 to designated file system and vice-versa.

Local File System To Amazon S3
  1. Login to DBSync with valid credentials. 
  2. Create a Project with name of your choice.
  3. Create Connectors - preferably of type Java and Database
  4. The Java Connector should have valid class Name, Username and Password - notably the class name is "awsS3Adapter" and the username and password are of Amazon S3 Storage. 
  5. Configure the Database Connector with any Database that is supported by DBSync. Please refer to DBSync DB connector documentation for more information. 
  6. Create a process with meaningful name - like S3ToLocal. Something that will be easy for other users to understand.
  7. Create a workflow with a valid Name, Trigger and Rules as explained in latter sections. 

Trigger Setup

  1. Select the data-source as Database.
  2. Choose the object corresponding to the Data-source. 

Rules Setup

  1. Add a rule with name of user choice. Then, select the Java Connector and Operation as Insert. 
  2. Set the target Object to upload directory that will write the total chosen directory with its files from designated file system to Amazon file system.
  3. Next the user should do the mapping as per his/her choice. Following samples  will help a user understand how this can be done . 

Mappings 

Target Field

Description

Validate Row

Has to be true. 

Bucket

Amazon Bucket to which it has to be written.

File pattern

The name of the directory. 

File Reference

The source path from where the directory should be read. 
For Eg: "C:/Users/Avankia111/Downloads/TestDirectory" in case of local machine this is the format.

Region

The Region the user's Amazon is hosted.

Running The Sync

We set Connectors, Trigger and Rules appropriately. Now it is time to Run sync and confirm that all the files from the designated directory have been copied to the destination i.e. Amazon s3.

Click 'Run Now' button located at the top right corner of the page - as shown in the above screen. If sync is successful executed, it shows up in the console. However, if there are errors, that will also be displayed in the Console.

After successful completion of sync, go to the Amazon S3 storage. Make sure that the files are copied along with correct Directory Name, File Names and data.

  • No labels