List: Big Data | Curated by Newt Tan | Medium

Nov 30, 2022

13 stories

Big Data

In

SoftwareMill Tech Blog

by

Michał Matłoka

How to structure your Scala application?

Scala is a powerful language. You are given a lot of features allowing to realize your applications in various ways.

Oct 23, 2019

How to structure your Scala application?

Oct 23, 2019

In

TDS Archive

by

Babatunde

Introduction to Apache Spark with Scala

This article is a follow-up note for the March edition of Scala-Lagos meet-up where we discussed Apache Spark, it’s capability and…

Mar 28, 2019

Introduction to Apache Spark with Scala

Mar 28, 2019

In

TDS Archive

by

João Pedro

A Fast Look at Spark Structured Streaming + Kafka

Learning the basics of how to use this powerful duo for stream-processing tasks

Nov 5, 2022

A Fast Look at Spark Structured Streaming + Kafka

Nov 5, 2022

In

codeburst

by

Kartik Khare

Make your Apache Spark programs run faster

Apache Spark is a popular distributed big data processing framework which is used by many companies to process data in batches as well as…

Mar 21, 2018

Make your Apache Spark programs run faster

Mar 21, 2018

In

HackerNoon.com

by

Karlijn Willems

PySpark Cheat Sheet: Spark in Python

Apache Spark is generally known as a fast, general and open-source engine for big data processing, with built-in modules for streaming…

Mar 22, 2017

PySpark Cheat Sheet: Spark in Python

Mar 22, 2017

In

Insight

by

Hoa Nguyen

Getting started with Spark and batch processing frameworks

What you need to know before you dive into big data processing with Apache Spark and other frameworks.

May 20, 2020

Getting started with Spark and batch processing frameworks

May 20, 2020

In

Becoming Human: Artificial Intelligence Magazine

by

Karlijn Willems

Apache Spark in Python: Beginner’s Guide

You might already know Apache Spark as a fast and general engine for big data processing, with built-in modules for streaming, SQL, machine…

May 9, 2017

Apache Spark in Python: Beginner’s Guide

May 9, 2017

This story is no longer available

Data@Urban

Democratizing Big Data Processing for the Education Data Portal

Earlier this year, we announced our plan to create a central source of preprocessed, big, local datasets spanning various sectors and…

Jan 28, 2020

Democratizing Big Data Processing for the Education Data Portal

Jan 28, 2020

In

spark-nlp

by

Juan Martinez

Serving Spark NLP via API (3/3): Databricks and MLFlow Serve APIs

“Serving Spark NLP via API” series, showcasing how to serve Spark NLP using Databricks Jobs and MLFlow Rest APIs

Feb 18, 2022

Serving Spark NLP via API (3/3): Databricks and MLFlow Serve APIs

Feb 18, 2022

In

spark-nlp

by

Juan Martinez

Serving Spark NLP via API (2/3): FastAPI and LightPipelines

“Serving Spark NLP via API” series, showcasing how to serve Spark NLP using FastAPI and LightPipelines

Feb 18, 2022

Serving Spark NLP via API (2/3): FastAPI and LightPipelines

Feb 18, 2022

In

spark-nlp

by

Juan Martinez

Serving Spark NLP via API (1/3): Microsoft Synapse ML

“Serving Spark NLP via API”, showcasing how to serve Spark NLP using Microsoft’s Synapse ML

Feb 18, 2022

Serving Spark NLP via API (1/3): Microsoft Synapse ML

Feb 18, 2022

In

spark-nlp

by

Juan Martinez

Spark NLP and MLFlow for Serialization and Experiment Tracking

How to use MLFlow for Serialization of Spark NLP models, and local and remote Experiment Tracking

Dec 16, 2021

Spark NLP and MLFlow for Serialization and Experiment Tracking

Dec 16, 2021

Newt Tan
16 Followers
In the end, the inventor is still the hero and always will be. Don’t give up on your dreams. We started with DVDs.
Following
Data Science Collective
Conception X
Checkmarx Zero
Damon Mohammadbagher
Machine Learning Algorithms from scratch
See all (19)

Help
Status
About
Careers
Press
Blog
Privacy
Terms
Text to speech
Teams