AWS Glue vs Azure Data Factory

Last Updated:

Our analysts compared AWS Glue vs Azure Data Factory based on data from our 400+ point analysis of ETL Tools, user reviews and our own crowdsourced data from our free software selection platform.

Azure Data Factory Software Tool

Product Basics

AWS Glue is a fully managed, event-driven serverless computing platform that extracts, cleanses and organizes data for insights. Automatic code generation ensures citizen data scientists and power users can create and schedule integration workflows. An event-driven architecture enables setting triggers to launch data integration processes.

A common data catalog with automatic schema generation ensures data is unique and easily accessible. With streaming data integration, it catalogs assets from datastores like Amazon S3, making it available for querying with Amazon Athena and Redshift Spectrum. Developers can access readymade endpoints to edit and test code.

Pros
  • Serverless & Scalable
  • Easy Visual Workflow
  • Built-in Data Connectors
  • Pay-per-Use Pricing
  • AWS Ecosystem Integration
Cons
  • Complex Transformations
  • Limited On-Premise Data
  • Python & Scala Only
  • Potential Cost Overruns
  • AWS Lock-in Concerns
read more...
Azure Data Factory orchestrates data movement and transformation across diverse cloud and on-premises sources. It caters to businesses struggling with data silos and complex integration needs. Key benefits include its visual interface for building ETL/ELT pipelines, native connectors to various data stores, and serverless execution for scalable data processing. User experiences highlight its ease of use, robust scheduling capabilities, and powerful data transformation tools. Compared to similar offerings, Azure Data Factory shines in its cloud-native design, integration with other Azure services, and cost-effective pay-per-use pricing based on data volume and execution duration.

Pros
  • Visual ETL/ELT builder
  • Native data store connectors
  • Serverless execution
  • Easy scheduling
  • Powerful data transformations
Cons
  • Limited custom code options
  • Steep learning curve for complex workflows
  • Potential cost increase with high data volume
  • Limited debugging options
  • Less control over serverless execution
read more...
$0.44/M-DPU-Hour
Free Trial is unavailable →
Get a free price quote
Tailored to your specific needs
$0.075/DIU Hour
Get a free price quote
Tailored to your specific needs
Small 
i
Medium 
i
Large 
i
Small 
i
Medium 
i
Large 
i
Windows
Mac
Linux
Android
Chromebook
Windows
Mac
Linux
Android
Chromebook
Cloud
On-Premise
Mobile
Cloud
On-Premise
Mobile

Product Assistance

Documentation
In Person
Live Online
Videos
Webinars
Documentation
In Person
Live Online
Videos
Webinars
Email
Phone
Chat
FAQ
Forum
Knowledge Base
24/7 Live Support
Email
Phone
Chat
FAQ
Forum
Knowledge Base
24/7 Live Support

Product Insights

  • Effortless Data Integration: Streamline data movement across diverse sources like databases, applications, and cloud storage with pre-built connectors and automated schema discovery.
  • Simplified Data Preparation: Clean, transform, and enrich data with a visual drag-and-drop interface and built-in transformations, eliminating the need for complex coding.
  • Serverless Scalability: Forget infrastructure management! Glue seamlessly scales to handle massive data volumes without upfront provisioning or ongoing maintenance.
  • Cost-Effective Flexibility: Pay-per-use pricing based on actual resource consumption makes Glue ideal for both small and large data pipelines, optimizing your costs.
  • Seamless AWS Integration: Leverage the power of the AWS ecosystem! Glue effortlessly integrates with S3, Redshift, and other AWS services, creating a unified data pipeline within your existing infrastructure.
  • Improved Data Accessibility: Deliver prepared data to data lakes, data warehouses, and analytics platforms, democratizing access for data scientists, analysts, and business users.
  • Enhanced Collaboration: Share data pipelines and workflows with other users and teams, fostering collaboration and streamlining data-driven workflows.
  • Centralized Data Catalog: Maintain a single source of truth for your data assets with Glue Data Catalog, ensuring data consistency and discoverability.
  • Continuous Monitoring and Optimization: Track job performance, identify bottlenecks, and optimize your pipelines for efficiency with built-in monitoring and logging tools.
  • Future-Proof Data Infrastructure: Stay ahead of the curve with Glue's serverless architecture and cloud-native approach, adapting to your evolving data needs with ease.
read more...
  • Streamlined Data Orchestration: Simplify data movement across diverse on-premises, cloud, and hybrid environments with a unified platform.
  • Boosted Developer Productivity: Leverage code-free and low-code data flows to build and manage pipelines without writing extensive scripts, saving time and resources.
  • Enhanced Scalability and Elasticity: Scale data pipelines seamlessly to handle fluctuating data volumes without infrastructure limitations, ensuring smooth performance.
  • Reduced Costs and Optimization: Pay-as-you-go pricing model and built-in optimization tools minimize infrastructure costs and maximize resource utilization.
  • Unified Data Governance: Implement consistent data security and compliance policies across all integrated data sources, ensuring data integrity and trust.
  • Accelerated Data Insights: Deliver faster and more reliable data pipelines to your analytics platforms, enabling faster time-to-insights and data-driven decision making.
  • Streamlined Data Migration: Easily migrate existing data integration workloads, including SSIS packages, to the cloud with minimal disruption and effort.
  • Rich Ecosystem of Connectors: Integrate with a vast array of on-premises and cloud data sources and applications, fostering a truly connected data landscape.
  • Enhanced Monitoring and Alerting: Gain real-time visibility into pipeline performance and proactively address potential issues with built-in monitoring and alerting features.
  • Continuous Innovation: Benefit from Microsoft's ongoing updates and enhancements to the platform, ensuring access to the latest data integration capabilities.
read more...
  • Console: Discover, transform and make available data assets for querying and analysis. Builds complex data integration pipelines; handles dependencies, filters bad data and retries jobs after failures. Monitor jobs and get task status alerts via Amazon Cloudwatch. 
  • Data Catalog: Gleans and stores metadata in the catalog for workflow authoring, with full version history. Search and discover desired datasets from the data catalog, irrespective of where they are located. Saves time and money – automatically computes statistics and registers partitions with a central metadata repository. 
  • Automatic Schema Discovery: Creates metadata automatically by gleaning schema, quality and data types through built-in datastore crawlers and stores it in the Data Catalog. Ensure up-to-date assets – run crawlers on a schedule, on-demand or based on event triggers. Manage streaming data schemas with the Schema Registry. 
  • Event-driven Architecture: Move data automatically into data lakes and warehouses by setting triggers based on a schedule or event. Extract, transform and load jobs with a Lambda function as soon as new data becomes available. 
  • Visual Data Prep: Prepare assets for analytics and machine learning through Glue DataBrew. Automate anomaly filtering, convert data to standard formats and rectify invalid values with more than 250 pre-designed transformations – no need to write code. 
  • Materialized Views: Create a virtual table from multiple different data sources by using SQL. Copies data from each source data store and creates a replica in the target datastore as a materialized view. Ensures data is always up-to-date by monitoring data in source stores continuously and updating target stores in real time. 
read more...
  • Data Source Connectivity: Visually integrate data sources with more than 90 pre-defined connectors through guided workflows. Connect to Amazon Redshift, Google BigQuery, HDFS, Oracle Exadata, Teradata, Salesforce, Marketo and ServiceNow, and all Azure data services. View data previews and customize as needed. 
  • Mapping Data Flow: Design code-free data transformation logic with an intuitive interface and visual tools. Schedule, control and monitor transformation tasks with easy point-and-click actions — the vendor manages code translation, path optimization and job runs at the back end. 
  • Authoring: Drag and drop to create end-to-end data processing workflows – from ingestion to reporting. Operationalize the pipeline using Apache Hive, Apache Pig, Azure HDInsight, Apache Spark and Azure Databricks. Upload data to warehouses like Azure Storage, then connect to analytics platforms for visual insights and reporting. 
  • Debugging: Debug the data pipeline as a whole or in parts — set breakpoints on specific workflows. 
  • Data Processing: Set event and schedule-based triggers to kick off the pipelines. Scales with Azure Event Grid to run event-based processing after upstream operations are complete. Speeds up ML-based pipelines and retrains processes as new data comes in. 
read more...

Product Ranking

#9

among all
ETL Tools

#12

among all
ETL Tools

Find out who the leaders are

Analyst Rating Summary

88
94
100
93
92
92
62
92
Show More Show More
Data Delivery
Performance and Scalability
Platform Capabilities
Platform Security
Workflow Management
Performance and Scalability
Platform Capabilities
Platform Security
Workflow Management
Data Transformation

Analyst Ratings for Functional Requirements Customize This Data Customize This Data

AWS Glue
Azure Data Factory
+ Add Product + Add Product
Data Delivery Data Quality Data Sources And Targets Connectivity Data Transformation Metadata Management Platform Capabilities Workflow Management 100 92 62 90 96 100 100 93 92 92 96 85 100 99 0 25 50 75 100
100%
0%
0%
90%
0%
10%
85%
8%
7%
77%
23%
0%
36%
0%
64%
89%
0%
11%
88%
0%
12%
96%
0%
4%
90%
0%
10%
60%
40%
0%
100%
0%
0%
100%
0%
0%
100%
0%
0%
90%
10%
0%

Analyst Ratings for Technical Requirements Customize This Data Customize This Data

100%
0%
0%
100%
0%
0%
100%
0%
0%
100%
0%
0%

User Sentiment Summary

Great User Sentiment 165 reviews
Great User Sentiment 128 reviews
85%
of users recommend this product

AWS Glue has a 'great' User Satisfaction Rating of 85% when considering 165 user reviews from 3 recognized software review sites.

88%
of users recommend this product

Azure Data Factory has a 'great' User Satisfaction Rating of 88% when considering 128 user reviews from 3 recognized software review sites.

4.0 (46)
4.6 (37)
4.4 (109)
4.4 (59)
3.9 (10)
4.2 (32)

Awards

SelectHub research analysts have evaluated AWS Glue and concluded it earns best-in-class honors for Workflow Management.

Workflow Management Award

we're gathering data

Synopsis of User Ratings and Reviews

Cost-Effective & Serverless: Pay only for resources used, eliminates server provisioning and maintenance
Simplified ETL workflows: Drag-and-drop UI & auto-generated code for easy job creation, even for non-programmers
Data Catalog: Unified metadata repository for seamless discovery & access across various data sources
Flexible Data Integration: Connects to diverse data sources & destinations (S3, Redshift, RDS, etc.)
Built-in Data Transformations: Apply pre-built & custom transformations within workflows for efficient data cleaning & shaping
Visual Data Cleaning (Glue DataBrew): Code-free data cleansing & normalization for analysts & data scientists
Scalability & Performance: Auto-scaling resources based on job needs, efficient Apache Spark engine for fast data processing
Community & Support: Active user community & helpful AWS support resources for problem-solving & best practices
Show more
Ease of Use for ETL/ELT Tasks: Users praise the intuitive drag-and-drop interface and pre-built connectors for simplifying data movement and transformation, even for complex ETL/ELT scenarios.
Faster Time to Insights: Many users highlight the improved data pipeline efficiency leading to quicker data availability for analysis and decision-making.
Cost Savings and Optimization: Pay-as-you-go pricing and built-in optimization features are frequently mentioned as helping users keep data integration costs under control.
Reduced Development Time: Code-free and low-code capabilities are appreciated for enabling faster pipeline development and reducing reliance on coding expertise.
Improved Data Governance: Unified data security and compliance across hybrid environments are valued by users dealing with sensitive data.
Show more
Limited Customization & Control: Visual interface and pre-built transformations may not be flexible enough for complex ETL needs, requiring manual coding or custom Spark jobs.
Debugging Challenges: Troubleshooting Glue jobs can be complex due to limited visibility into underlying Spark code and distributed execution, making error resolution time-consuming.
Performance Limitations for Certain Workloads: Serverless architecture may not be optimal for latency-sensitive workloads or large-scale data processing, potentially leading to bottlenecks.
Vendor Lock-in & Portability: Migrating ETL workflows from Glue to other platforms can be challenging due to its proprietary nature and lack of open-source compatibility.
Pricing Concerns for Certain Use Cases: Pay-per-use model can be expensive for long-running ETL jobs or processing massive datasets, potentially exceeding budget constraints.
Show more
Limited Debugging Tools: Troubleshooting complex pipelines can be challenging due to lack of advanced debugging features and reliance on basic log analysis.
Cost Overruns: Unoptimized pipelines or unexpected usage spikes can lead to higher-than-anticipated costs in the pay-as-you-go model.
Learning Curve for Data Flows: The code-free data flow visual designer, while powerful, can have a learning curve for non-technical users, hindering adoption.
Azure Ecosystem Reliance: Integration with non-Azure services often requires workarounds or custom development, limiting flexibility.
Version Control Challenges: Lack of native version control features necessitates integration with external tools for effective pipeline management.
Show more

User reviews of AWS Glue paint a picture of a powerful and user-friendly ETL tool for the cloud, but one with limitations. Praise often centers around its intuitive visual interface, making complex data pipelines accessible even to non-programmers. Pre-built connectors and automated schema discovery further simplify setup, saving users time and effort. Glue's serverless nature and tight integration with the broader AWS ecosystem are also major draws, offering seamless scalability and data flow within a familiar environment. However, some users find Glue's strength in simplicity a double-edged sword. For complex transformations beyond basic filtering and aggregation, custom scripting in Python or Scala is required, limiting flexibility for those unfamiliar with these languages. On-premise data integration is another pain point, with Glue primarily catering to cloud-based sources. This leaves users seeking hybrid deployments or integration with legacy systems feeling somewhat stranded. Cost also arises as a concern. Glue's pay-per-use model can lead to unexpected bills for large data volumes or intricate pipelines, unlike some competitors offering fixed monthly subscriptions. Additionally, Glue's deep integration with AWS can create lock-in anxieties for users worried about switching cloud providers in the future. Overall, user reviews suggest Glue shines in cloud-based ETL for users comfortable with its visual interface and scripting limitations. Its scalability, ease of use, and AWS integration are undeniable strengths. However, for complex transformations, on-premise data needs, or cost-conscious users, alternative tools may offer a better fit.

Show more

Overall, user reviews of Azure Data Factory (ADF) paint a picture of a powerful and versatile data integration tool with both strengths and limitations. Many users praise its ease of use, particularly the drag-and-drop interface and pre-built connectors, which significantly simplify ETL/ELT tasks even for complex scenarios. This is especially valuable for reducing development time and making data pipelines accessible to users with less coding expertise. Another major advantage highlighted by users is faster time to insights. Streamlined data pipelines in ADF lead to quicker data availability for analysis, enabling data-driven decision making with minimal delay. Additionally, the pay-as-you-go pricing model and built-in optimization features are appreciated for helping users control costs. This is particularly important for organizations with fluctuating data volumes or unpredictable usage patterns. However, some limitations also emerge from user reviews. Debugging complex pipelines can be challenging due to the lack of advanced debugging tools and reliance on basic logging. This can lead to frustration and lost time when troubleshooting issues. Additionally, the learning curve for data flows, while ultimately powerful, can hinder adoption for less technical users who might prefer a more code-centric approach. Compared to similar products, ADF's strengths lie in its user-friendliness, scalability, and cost-effectiveness. Notably, its extensive library of pre-built connectors gives it an edge over some competitors in terms of out-of-the-box integration capabilities. However, other tools might offer more advanced debugging features or cater better to users with strong coding skills. Ultimately, the decision of whether ADF is the right choice depends on individual needs and priorities. For organizations looking for a user-friendly, scalable, and cost-effective data integration solution, ADF is a strong contender. However, it's essential to consider its limitations, particularly around debugging and data flow learning curve, and compare it to alternative tools to ensure the best fit for specific requirements.

Show more

Screenshots

Top Alternatives in ETL Tools


Azure Data Factory

Cloud Data Fusion

Dataflow

DataStage

Fivetran

Hevo

IDMC

Informatica PowerCenter

InfoSphere Information Server

Integrate.io

Oracle Data Integrator

Pentaho

Qlik Talend Data Integration

SAP Data Services

SAS Data Management

Skyvia

SQL Server

SQL Server Integration Services

Talend

TIBCO Cloud Integration

Related Categories

Head-to-Head Comparison

WE DISTILL IT INTO REAL REQUIREMENTS, COMPARISON REPORTS, PRICE GUIDES and more...

Compare products
Comparison Report
Just drag this link to the bookmark bar.
?
Table settings