Can Someone tell about AWS Activities in AWS Data Pipeline

0 votes
Oct 8, 2018 in Cloud Computing by brat_1
• 7,200 points
655 views

1 answer to this question.

0 votes

In AWS Data Pipeline, an activity is a pipeline component that defines the work to perform. AWS Data Pipeline provides several pre-packaged activities that accommodate common scenarios, such as moving data from one location to another, running Hive queries, and so on. Activities are extensible, so you can run your own custom scripts to support endless combinations.

AWS Data Pipeline supports the following types of activities:

CopyActivity

Copies data from one location to another.

EmrActivity

Runs an Amazon EMR cluster.

HiveActivity

Runs a Hive query on an Amazon EMR cluster.

HiveCopyActivity

Runs a Hive query on an Amazon EMR cluster with support for advanced data filtering and support for S3DataNode and DynamoDBDataNode.

PigActivity

Runs a Pig script on an Amazon EMR cluster.

RedshiftCopyActivity

Copies data to and from Amazon Redshift tables.

ShellCommandActivity

Runs a custom UNIX/Linux shell command as an activity.

SqlActivity

Runs a SQL query on a database.

Some activities have special support for staging data and database tables. For more information, see Staging Data and Tables with Pipeline Activities.

answered Oct 8, 2018 by Meci Matt
• 9,460 points

Related Questions In Cloud Computing

0 votes
1 answer

Can someone tell me about AWS Aurora?

Amazon Aurora is a MySQL and PostgreSQL ...READ MORE

answered Sep 20, 2018 in Cloud Computing by DragonLord999
• 8,450 points
630 views
0 votes
1 answer

Can someone tell about Amazon Web Services Certificate Manager?

Amazon Web Services security manager handles the ...READ MORE

answered Jul 9, 2018 in Cloud Computing by Meci Matt
• 9,460 points
552 views
0 votes
1 answer

AWS: Can someone tell me what is a Certificate Manager?

Amazon Web Services security manager handles the ...READ MORE

answered Jul 10, 2018 in Cloud Computing by DragonLord999
• 8,450 points
603 views
0 votes
1 answer

AWS: Can Someone brief me about Elastic Block Storage

EBS is virtual storage area network (SAN) ...READ MORE

answered Jul 16, 2018 in Cloud Computing by hemant
• 5,790 points
588 views
0 votes
1 answer

Can Someone tell me why do we need AWS cloud watch?

Amazon CloudWatch is a monitoring and management ...READ MORE

answered Aug 2, 2018 in Cloud Computing by Meci Matt
• 9,460 points
510 views
0 votes
1 answer

Can someone tell me what is AWS MQ?

Amazon MQ is a managed message broker ...READ MORE

answered Aug 14, 2018 in Cloud Computing by hemant
• 5,790 points
786 views
0 votes
1 answer

Can someone tell me what is AWS Lex?

Amazon Lex is a service for building ...READ MORE

answered Aug 22, 2018 in Cloud Computing by DragonLord999
• 8,450 points
546 views
0 votes
1 answer

what is WAF in AWS? Can someone explain?

AWS WAF is a web application firewall ...READ MORE

answered Sep 4, 2018 in Cloud Computing by Meci Matt
• 9,460 points
671 views
0 votes
1 answer

AWS: Can someone tell about importance of Well Defined Interfaces in Loose Coupling

Loose Coupling As application complexity increases, a desirable ...READ MORE

answered Jul 31, 2018 in Cloud Computing by Meci Matt
• 9,460 points
706 views
0 votes
1 answer

Can someone tell me about AWS Code Commit?

AWS CodeCommit is a fully-managed source control service that ...READ MORE

answered Aug 21, 2018 in Cloud Computing by Meci Matt
• 9,460 points
620 views
webinar REGISTER FOR FREE WEBINAR X
REGISTER NOW
webinar_success Thank you for registering Join Edureka Meetup community for 100+ Free Webinars each month JOIN MEETUP GROUP