Replies: 1 comment
-
i have the same problems.when i set jobmanager and taskmanager via configuration on web,it become the same limits and requests as well. When i set limits and requests via k8s pod template, it can't works. |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
我们创建了k8s aplication作业,并设置了k8s的resource,但是启动任务失败,内存设置失败,依然是1600M,也尝试在Pod Template设置,也是无效,请帮忙看看是什么问题?具体配置如下图:
其他日志:
'''
Caused by: org.apache.flink.configuration.IllegalConfigurationException: JobManager memory configuration failed: The configured Total Process Memory size (1.563gb (1677721600 bytes)) is less than the sum of the derived Total Flink Memory size (2.125gb (2281701376 bytes)) and the configured or default JVM Metaspace size (256.000mb (268435456 bytes)).
at org.apache.flink.runtime.jobmanager.JobManagerProcessUtils.processSpecFromConfigWithNewOptionToInterpretLegacyHeap(JobManagerProcessUtils.java:78)
at org.apache.flink.client.deployment.AbstractContainerizedClusterClientFactory.getClusterSpecification(AbstractContainerizedClusterClientFactory.java:43)
at org.apache.streampark.flink.client.trait.KubernetesNativeClientTrait.getK8sClusterDescriptorAndSpecification(KubernetesNativeClientTrait.scala:158)
at org.apache.streampark.flink.client.trait.KubernetesNativeClientTrait.getK8sClusterDescriptorAndSpecification$(KubernetesNativeClientTrait.scala:154)
at org.apache.streampark.flink.client.impl.KubernetesNativeApplicationClient$.getK8sClusterDescriptorAndSpecification(KubernetesNativeApplicationClient.scala:35)
at org.apache.streampark.flink.client.impl.KubernetesNativeApplicationClient$.doSubmit(KubernetesNativeApplicationClient.scala:66)
at org.apache.streampark.flink.client.trait.FlinkClientTrait.submit(FlinkClientTrait.scala:123)
at org.apache.streampark.flink.client.trait.FlinkClientTrait.submit$(FlinkClientTrait.scala:60)
at org.apache.streampark.flink.client.impl.KubernetesNativeApplicationClient$.submit(KubernetesNativeApplicationClient.scala:35)
at org.apache.streampark.flink.client.FlinkClientHandler$.submit(FlinkClientHandler.scala:40)
at org.apache.streampark.flink.client.FlinkClientHandler.submit(FlinkClientHandler.scala)
... 15 more
Caused by: org.apache.flink.configuration.IllegalConfigurationException: The configured Total Process Memory size (1.563gb (1677721600 bytes)) is less than the sum of the derived Total Flink Memory size (2.125gb (2281701376 bytes)) and the configured or default JVM Metaspace size (256.000mb (268435456 bytes)).
at org.apache.flink.runtime.util.config.memory.ProcessMemoryUtils.deriveJvmOverheadFromTotalFlinkMemoryAndOtherComponents(ProcessMemoryUtils.java:202)
at org.apache.flink.runtime.util.config.memory.ProcessMemoryUtils.deriveJvmMetaspaceAndOverheadFromTotalFlinkMemory(ProcessMemoryUtils.java:172)
at org.apache.flink.runtime.util.config.memory.ProcessMemoryUtils.deriveProcessSpecWithExplicitInternalMemory(ProcessMemoryUtils.java:93)
at org.apache.flink.runtime.util.config.memory.ProcessMemoryUtils.memoryProcessSpecFromConfig(ProcessMemoryUtils.java:76)
at org.apache.flink.runtime.jobmanager.JobManagerProcessUtils.processSpecFromConfig(JobManagerProcessUtils.java:83)
at org.apache.flink.runtime.jobmanager.JobManagerProcessUtils.processSpecFromConfigWithNewOptionToInterpretLegacyHeap(JobManagerProcessUtils.java:73)
... 25 more
'''
Beta Was this translation helpful? Give feedback.
All reactions