回复：datadog failed to send report

[seeksst]

Hi,

If you don’t care about losing some metrics, you can edit log4j.properties to ignore it.

log4j.logger.org.apache.flink.runtime.metrics=ERROR

BTW, Whether all machines can telnet datadog port? 

Whether the number of requests exceeds the datadog's processing capacity?

 原始邮件 

发件人: Fanbin Bu<[hidden email]>

收件人: user<[hidden email]>

发送时间: 2020年6月24日(周三) 12:05

主题: datadog failed to send report

Hi,

Does any have any idea on the following error msg: (it flooded my task manager log)

I do have datadog metrics present so this is probably only happens for some metrics.

2020-06-24 03:27:15,362 WARN  org.apache.flink.metrics.datadog.DatadogHttpClient            - Failed sending request to Datadog
java.net.SocketTimeoutException: timeout
	at org.apache.flink.shaded.okio.Okio$4.newTimeoutException(Okio.java:227)
	at org.apache.flink.shaded.okio.AsyncTimeout.exit(AsyncTimeout.java:284)
	at org.apache.flink.shaded.okio.AsyncTimeout$2.read(AsyncTimeout.java:240)
	at org.apache.flink.shaded.okio.RealBufferedSource.indexOf(RealBufferedSource.java:344)
	at org.apache.flink.shaded.okio.RealBufferedSource.readUtf8LineStrict(RealBufferedSource.java:216)
	at org.apache.flink.shaded.okio.RealBufferedSource.readUtf8LineStrict(RealBufferedSource.java:210)
	at org.apache.flink.shaded.okhttp3.internal.http1.Http1Codec.readResponseHeaders(Http1Codec.java:189)
	at org.apache.flink.shaded.okhttp3.internal.http.CallServerInterceptor.intercept(CallServerInterceptor.java:75)
	at org.apache.flink.shaded.okhttp3.internal.http.RealInterceptorChain.proceed(RealInterceptorChain.java:92)
	at org.apache.flink.shaded.okhttp3.internal.connection.ConnectInterceptor.intercept(ConnectInterceptor.java:45)
	at org.apache.flink.shaded.okhttp3.internal.http.RealInterceptorChain.proceed(RealInterceptorChain.java:92)
	at org.apache.flink.shaded.okhttp3.internal.http.RealInterceptorChain.proceed(RealInterceptorChain.java:67)
	at org.apache.flink.shaded.okhttp3.internal.cache.CacheInterceptor.intercept(CacheInterceptor.java:93)
	at org.apache.flink.shaded.okhttp3.internal.http.RealInterceptorChain.proceed(RealInterceptorChain.java:92)
	at org.apache.flink.shaded.okhttp3.internal.http.RealInterceptorChain.proceed(RealInterceptorChain.java:67)
	at org.apache.flink.shaded.okhttp3.internal.http.BridgeInterceptor.intercept(BridgeInterceptor.java:93)
	at org.apache.flink.shaded.okhttp3.internal.http.RealInterceptorChain.proceed(RealInterceptorChain.java:92)
	at org.apache.flink.shaded.okhttp3.internal.http.RetryAndFollowUpInterceptor.intercept(RetryAndFollowUpInterceptor.java:120)
	at org.apache.flink.shaded.okhttp3.internal.http.RealInterceptorChain.proceed(RealInterceptorChain.java:92)
	at org.apache.flink.shaded.okhttp3.internal.http.RealInterceptorChain.proceed(RealInterceptorChain.java:67)
	at org.apache.flink.shaded.okhttp3.RealCall.getResponseWithInterceptorChain(RealCall.java:185)
	at org.apache.flink.shaded.okhttp3.RealCall$AsyncCall.execute(RealCall.java:135)
	at org.apache.flink.shaded.okhttp3.internal.NamedRunnable.run(NamedRunnable.java:32)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)
Caused by: java.net.SocketException: Socket closed
	at java.net.SocketInputStream.read(SocketInputStream.java:204)
	at java.net.SocketInputStream.read(SocketInputStream.java:141)
	at sun.security.ssl.InputRecord.readFully(InputRecord.java:465)
	at sun.security.ssl.InputRecord.read(InputRecord.java:503)
	at sun.security.ssl.SSLSocketImpl.readRecord(SSLSocketImpl.java:975)
	at sun.security.ssl.SSLSocketImpl.readDataRecord(SSLSocketImpl.java:933)
	at sun.security.ssl.AppInputStream.read(AppInputStream.java:105)
	at org.apache.flink.shaded.okio.Okio$2.read(Okio.java:138)
	at org.apache.flink.shaded.okio.AsyncTimeout$2.read(AsyncTimeout.java:236)
	... 23 more