SparkUI 에러 InjectionManagerFactory not found
springframework 에서 spark를 조작하는데 spark UI에서 executor를 실행하면 아래와 같은 오류가 발생한다.
Caused by: java.lang.IllegalStateException: InjectionManagerFactory not found.
at org.glassfish.jersey.internal.inject.Injections.lambda$lookupInjectionManagerFactory$0(Injections.java:74)
at java.util.Optional.orElseThrow(Optional.java:290)
at org.glassfish.jersey.internal.inject.Injections.lookupInjectionManagerFactory(Injections.java:74)
at org.glassfish.jersey.internal.inject.Injections.createInjectionManager(Injections.java:69)
at org.glassfish.jersey.server.ApplicationHandler.<init>(ApplicationHandler.java:259)
at org.glassfish.jersey.servlet.WebComponent.<init>(WebComponent.java:311)
at org.glassfish.jersey.servlet.ServletContainer.init(ServletContainer.java:154)
at org.glassfish.jersey.servlet.ServletContainer.init(ServletContainer.java:346)
at javax.servlet.GenericServlet.init(GenericServlet.java:203)
at org.spark_project.jetty.servlet.ServletHolder.initServlet(ServletHolder.java:643)
... 23 common frames omitted
해결방법은 아래의 dependency를 추가해주면된다.
implementation 'org.glassfish.jersey.inject:jersey-hk2:2.30'
'BackEnd > Spark' 카테고리의 다른 글
Spark SQL API (0) | 2020.03.09 |
---|---|
cleaned accumulator [number] (0) | 2020.03.09 |
[Spark] RDD Persistence 와 Caching (0) | 2020.03.05 |
스파크 SQL 사용하여 파일로 보내기 (0) | 2020.03.02 |
java.io.InvalidClassException: org.apache.spark.rdd.RDD (0) | 2020.02.18 |