Create SparkConf for apache spark - Java Big Data

Java examples for Big Data:apache spark

  1. HOME
  2. Java
  3. Big Data
  4. apache spark

Description

Create SparkConf for apache spark

Demo Code

import java.util.*;
import org.apache.spark.api.java.*;
import org.apache.spark.*;

public class Main {
  public static void main(String[] args) {
    SparkConf conf = new SparkConf().setAppName("test").setMaster("local");
    JavaSparkContext sc = new JavaSparkContext(conf);

    JavaRdd<String> rdd = sc.parallelize(Arrays.asList("a b", "b c", "c d", "d e"));

    JavaRdd<String> output = rdd.map(x -> x.split(" "));

    output.foreach(x -> System.out.println(x));

  }/*w ww.jav  a  2  s.c  o m*/
}

Related Tutorials