ViewTube

ViewTube
Sign inSign upSubscriptions
Filters

Upload date

Type

Duration

Sort by

Features

Reset

92 results

The Debug Zone
Best Practices for Creating SparkSession in Scala for Unit Tests and Spark Submit

In this video, we delve into the best practices for creating a SparkSession in Scala, specifically tailored for unit testing and Spark ...

2:41
Best Practices for Creating SparkSession in Scala for Unit Tests and Spark Submit

0 views

2 months ago

The Debug Zone
Understanding Return Values in Spark Scala UDFs: A Comprehensive Guide

In this video, we delve into the intricacies of return values in Spark Scala User Defined Functions (UDFs). Understanding how to ...

3:51
Understanding Return Values in Spark Scala UDFs: A Comprehensive Guide

3 views

11 months ago

The Debug Zone
How to Pretty Print DataFrames in Zeppelin with Spark and Scala

In this video, we will explore the powerful capabilities of Apache Zeppelin for visualizing and presenting data using Spark and ...

1:39
How to Pretty Print DataFrames in Zeppelin with Spark and Scala

5 views

5 months ago

The Debug Zone
How to Retrieve the Latest Timestamp Row in Spark Dataset with Scala

In this video, we will explore how to efficiently retrieve the latest timestamp row from a Spark Dataset using Scala. As data ...

1:37
How to Retrieve the Latest Timestamp Row in Spark Dataset with Scala

4 views

1 month ago

The Debug Zone
How to Run Scala Scripts with Spark-Submit: A Step-by-Step Guide

In this video, we'll explore the powerful combination of Scala and Apache Spark, focusing on how to efficiently run Scala scripts ...

3:33
How to Run Scala Scripts with Spark-Submit: A Step-by-Step Guide

32 views

11 months ago

The Debug Zone
Spark Scala Error: Cannot Upcast from String to Int - Solutions Explained

In this video, we dive into a common issue faced by developers working with Spark and Scala: the "Cannot Upcast from String to ...

2:09
Spark Scala Error: Cannot Upcast from String to Int - Solutions Explained

0 views

2 months ago

The Debug Zone
Resolving Warnings in Scala/Spark Projects with SBT: A Step-by-Step Guide

In this video, we dive into the common warnings encountered in Scala and Spark projects when using SBT (Simple Build Tool).

2:10
Resolving Warnings in Scala/Spark Projects with SBT: A Step-by-Step Guide

2 views

1 month ago

The Debug Zone
Convert Array of Struct to Map in Spark Scala DataFrame: A Step-by-Step Guide

In this video, we will explore the process of converting an array of structs into a map within a Spark Scala DataFrame.

1:29
Convert Array of Struct to Map in Spark Scala DataFrame: A Step-by-Step Guide

7 views

4 months ago

The Debug Zone
How to Add Days to Date Column in Spark Scala DataFrame: Step-by-Step Guide

In this video, we will explore a practical and essential skill for data manipulation in Apache Spark using Scala. Specifically, we'll ...

3:32
How to Add Days to Date Column in Spark Scala DataFrame: Step-by-Step Guide

8 views

11 months ago

The Debug Zone
How to Delete First Few Rows in DataFrame Using Scala/Spark: A Step-by-Step Guide

In this video, we will explore a practical approach to manipulating DataFrames in Scala and Spark by focusing on how to delete ...

1:54
How to Delete First Few Rows in DataFrame Using Scala/Spark: A Step-by-Step Guide

1 view

2 months ago

The Debug Zone
Resolving Unsupported Literal Type Class Error in Apache Spark with Scala

In this video, we delve into a common challenge faced by developers working with Apache Spark and Scala: the Unsupported ...

1:54
Resolving Unsupported Literal Type Class Error in Apache Spark with Scala

12 views

6 months ago

The Debug Zone
Spark SQL Scala API: Fix 'No Encoder Found for TimestampType' Error

In this video, we dive into a common challenge faced by developers working with Spark SQL and the Scala API: the 'No Encoder ...

3:18
Spark SQL Scala API: Fix 'No Encoder Found for TimestampType' Error

8 views

11 months ago

The Debug Zone
Convert String Milliseconds to Timestamp in Spark 2.1 with Scala

In this video, we will explore how to convert string representations of milliseconds into timestamps using Apache Spark 2.1 with ...

1:30
Convert String Milliseconds to Timestamp in Spark 2.1 with Scala

32 views

5 months ago

The Debug Zone
How to Split Comma-Separated Strings in Spark Scala DataFrame for N Values

In this video, we will explore the process of splitting comma-separated strings within a Spark Scala DataFrame, specifically ...

1:55
How to Split Comma-Separated Strings in Spark Scala DataFrame for N Values

2 views

4 months ago

The Debug Zone
How to Filter Spark RDD by Element Class: A Step-by-Step Guide

In this video, we will explore the powerful capabilities of Apache Spark by focusing on how to filter Resilient Distributed Datasets ...

1:37
How to Filter Spark RDD by Element Class: A Step-by-Step Guide

2 views

9 months ago

The Debug Zone
Spark: How to Read a File Conditionally Based on Path Existence

In this video, we delve into the powerful capabilities of Apache Spark, focusing on how to read files conditionally based on their ...

2:16
Spark: How to Read a File Conditionally Based on Path Existence

1 view

3 months ago

The Debug Zone
How to Access Previous Row Data in Apache Spark: A Step-by-Step Guide

In this video, we delve into the powerful capabilities of Apache Spark, focusing on how to access previous row data within your ...

1:48
How to Access Previous Row Data in Apache Spark: A Step-by-Step Guide

21 views

4 months ago

The Debug Zone
Creating UDFs in Scala for MD5 Hashing: A Step-by-Step Guide

In this video, we will explore the process of creating User Defined Functions (UDFs) in Scala specifically for MD5 hashing.

1:29
Creating UDFs in Scala for MD5 Hashing: A Step-by-Step Guide

12 views

6 months ago

BigDatapediaAI
How I Automated PySpark with a Single Prompt (MCP Demo) | Future of Data Engineering (PySpark + MCP)

How I Automated PySpark with a Single Prompt (MCP Demo) | Future of Data Engineering (PySpark + MCP) Registration: ...

1:20
How I Automated PySpark with a Single Prompt (MCP Demo) | Future of Data Engineering (PySpark + MCP)

99 views

1 month ago

The Debug Zone
How to Read JSON Files into Spark Dataset and Add Columns from a Map

In this video, we'll explore the powerful capabilities of Apache Spark for handling JSON files. You'll learn how to efficiently read ...

2:17
How to Read JSON Files into Spark Dataset and Add Columns from a Map

0 views

1 month ago