Start free
Tools · Category

distributed processing, ranked by real usage_

As of 4 November 2026, Apache Spark leads distributed processing with 4,705 companies naming it in job postings, ahead of PySpark at 2,336.

As of 4 November 2026 · refreshed daily · counts move as websites, DNS and career sites are re-read.

Leader
Apache Spark · 4,705
Runner-up
PySpark · 2,336
Most hiring, 90 days
Apache Spark
Highest postings per company
Starburst
Catalogue
T-1.0.1-prov
15,275companies across the category
31%of them on Apache Spark
49,982postings naming a distributed processing in 90 days
32tools with enough evidence to rank
02 — Ranking

Every distributed processing we can measure

Companies naming the tool, and postings naming it in the last 90 days. Bars are relative to the leader.

#ToolCompaniescompaniesPostings, 90 dayspostingsper company
1
Apache SparkApache Software Foundation
4,705
17,4343.7
2
PySparkApache Software Foundation
2,336
7,5863.2
3
Apache HadoopApache Software Foundation
1,762
8,0574.6
4
Apache FlinkApache Software Foundation
943
2,5462.7
5
Apache HiveApache Software Foundation
844
2,3662.8
6
Google Cloud DataflowGoogle
490
1,6593.4
7
RayAnyscale
477
1,2512.6
8
Spark SQLApache Software Foundation
389
9942.6
9
TrinoTrino Software Foundation
329
9122.8
10
PrestoLinux Foundation (Presto Foundation)
323
6972.2
11
Spark StreamingApache Software Foundation
318
6041.9
12
MapReduceApache Software Foundation
276
6502.4
13
Apache BeamApache Software Foundation
246
6172.5
14
ClouderaCloudera
208
7513.6
15
Apache PigApache Software Foundation
187
2841.5
16
DaskNumFOCUS
183
2941.6
17
Google Cloud DataprocGoogle
182
5633.1
18
Apache StormApache Software Foundation
172
2921.7
19
Kafka StreamsApache Software Foundation
146
3482.4
20
Amazon EMRAmazon
136
3802.8
21
Apache ImpalaApache Software Foundation
136
4223.1
22
Spark Structured StreamingApache Software Foundation
104
2092.0
23
DenodoDenodo
67
1972.9
24
Hortonworks Data PlatformCloudera
55
1031.9
25
Azure Stream AnalyticsMicrosoft
53
1052.0
26
StarburstStarburst
46
2655.8
27
MapRHPE
43
581.3
28
Azure HDInsightMicrosoft
40
892.2
29
Cloudera Data PlatformCloudera
28
662.4
30
ksqlDBConfluent
21
562.7
31
Apache DataFusionApache Software Foundation
20
984.9
32
Apache SamzaApache Software Foundation
10
292.9
03 — Head to head

Compare two tools

Same data, two columns: who chooses which by size, industry and country.

Apache Spark vs PySpark4,705 · 2,336Apache Spark vs Apache Hadoop4,705 · 1,762Apache Spark vs Apache Flink4,705 · 943Apache Spark vs Apache Hive4,705 · 844Apache Spark vs Google Cloud Dataflow4,705 · 490PySpark vs Apache Hadoop2,336 · 1,762PySpark vs Apache Flink2,336 · 943PySpark vs Apache Hive2,336 · 844PySpark vs Google Cloud Dataflow2,336 · 490Apache Hadoop vs Apache Flink1,762 · 943Apache Hadoop vs Apache Hive1,762 · 844Apache Hadoop vs Google Cloud Dataflow1,762 · 490Apache Flink vs Apache Hive943 · 844Apache Flink vs Google Cloud Dataflow943 · 490Apache Hive vs Google Cloud Dataflow844 · 490
Cite this

Quote the sentence with the date and the link. The numbers change daily; the link always shows the current ones.

Apache Spark leads distributed processing with 4,705 companies naming it in job postings, ahead of PySpark at 2,336. (Breaknorm, 4 November 2026, https://breaknorm.co/tools/category/distributed-processing)
How we know

Read from the source, not self-reported

Every number on this page can be traced to a page we crawled or a posting we read. Full methodology →

  • CatalogueBreaknorm technology catalogue T-1.0.1-prov: 6,296 tools with vendor and category, editions folded into their parent.
  • CompaniesCompanies whose own postings name the tool as the team's system, any confidence. Candidate wish-lists excluded.
  • 90-day postingsOpen postings first seen or posted in the last 90 days that name the tool.
  • Not countedTools used by teams that do not post jobs, and companies without a career site we can read.
FAQ

distributed processing: questions

How is this ranking made?

By the number of companies whose own job postings name the tool as the team's system, from the Breaknorm technology catalogue (version T-1.0.1-prov). No vendor paid for a position and no editor chose the order.

Why is this different from review-site rankings?

Review sites rank by reviews collected. This ranks by companies hiring people to work in the tool, which is closer to seats in use. It under-counts tools used by teams that rarely post jobs.

What about product editions?

Editions and sub-products () are counted under the parent so no company is counted twice.

Can I get the companies behind a number?

Yes: click a tool, see the first 20, and sign up for the full list with verified e-mails. Counting is free.

Companies and people

Get the companies your way

The same data as a search, over MCP and the API, as bulk files, or pushed to you as it changes.

SearchCompany searchFilter on what a company actually does→SearchPeople searchDecision makers, normalized and verified→MCP and APICompanies over MCP and APICount, search and export from your agent→DatasetCompany and People datasetThe whole market in your warehouse→DataCoverage by countryCheck your market before you start→SearchLocal businessesThe same database, by category and city→

Every company on every tool,
ranked by what they say

Connect the MCP server, ask which companies run a tool, and get 1,000 records free.

Start free with 1,000 records
  1. 01Sign up, no card
  2. 02Connect Claude, ChatGPT or an API key
  3. 03Ask for your market, 1,000 records free