Skip to content

RajasekarSribalan/Apache-Spark

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

32 Commits
 
 
 
 
 
 
 
 

Repository files navigation

Apache-Spark

Spark programs

1.Word count

############################################################################################################################### Spark-Shell

import org.apache.spark.SparkConf

import org.apache.spark.SparkContext

import org.apache.spark._

val textFile = sc.textFile("hdfs:////inputs/input1.txt")

val counts = textFile.flatMap(line => line.split(" ")).map(word => (word,1)).reduceByKey(_ + _)

val textFile = sc.textFile("hdfs:////inputs/input1.txt")

###############################################################################################################################

About

Apache Spark

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

 
 
 

Contributors

Languages