Amazing technological breakthrough possible @S-Logix

Office Address

  • #5, First Floor, 4th Street Dr. Subbarayan Nagar Kodambakkam, Chennai-600 024 Landmark : Samiyar Madam
  • +91- 81240 01111

Social List

How to access HDFS file system in Apache Spark?

  • The following segment accesses the file inputdata.txt stored in HDFSCode Segment

    SparkConf conf = new SparkConf().setAppName("Sample");
    JavaSparkContext sc = new JavaSparkContext(conf);
    JavaRDD file =sc.textFile("hdfs://localhost:54310/inputdata.txt");