Connect Hadoop to ElasticSearch using Talend

(BLOG IN PROGRESS – INCOMPLETE)

This blog will show how to update an ElasticSearch index with data from HDFS file using the Talend Open Studio for Big Data ETL tool.

  1. First create a new job in Talend Studio such as HDFStoESindexjob.
  2. Drag the following components into the Design area:
    • tHDFSconnection_1—-onsubok—-> tHDFSinput_1—–row1(Main)–> tWriteJSONField_2—–row2(Main)—>tRESTClient_1

3.

 

Talend Tutorials:

https://community.talend.com/t5/custom/page/page-id/Tutorials

Advertisements

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out /  Change )

Google photo

You are commenting using your Google account. Log Out /  Change )

Twitter picture

You are commenting using your Twitter account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )

Connecting to %s

This site uses Akismet to reduce spam. Learn how your comment data is processed.