讨论数量:
- Platform: WIN10
- python: 3.12.4
- JAVA: 1.8.0_421 (jre-8u421-windows-x64.exe)
- pyspark: 3.5.2
- 环保局变量: JAVA_HOME=C:\Program Files\Java\jre1.8.0_421
- 环保局变量: path=%PATH%;C:\Program Files\Java\jre1.8.0_421\bin
from pyspark import SparkConf, SparkContext
conf = SparkConf().setMaster("local[*]").setAppName("test_spark_app")
sc = SparkContext(conf=conf)
print(sc.version)
sc.stop()
Setting default log level to "WARN".
To adjust logging level use sc.setLogLevel(newLevel). For SparkR, use setLogLevel(newLevel).
24/08/16 17:06:28 WARN NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
3.5.2
推荐文章: