Create JavaSparkContext in apache spark - Java Big Data

Java examples for Big Data:apache spark

  1. HOME
  2. Java
  3. Big Data
  4. apache spark

Description

Create JavaSparkContext in apache spark

Demo Code

  import java.util.*;
  import org.apache.spark.api.java.*;
  import org.apache.spark.*;

  public class Main {
      public static void main(String[] args) {
  SparkConf conf = new SparkConf().setAppName("test").setMaster("local");
  JavaSparkContext sc = new JavaSparkContext(conf);

  List<Integer> data = Arrays.asList(1, 2, 3, 4, 5);
  int result = sc
    .parallelize(data)//from  ww  w  .  j a v a  2 s  .  co  m
    .map(a -> a * a)
    .reduce((a, b) -> a + b);

  System.out.println(">>>>> Result: " + result);
}
  }

Related Tutorials