Jetty Component Dump

Jetty is based on components organized as a tree of objects (refer to this section), with the Server instance or the HttpClient instance typically at the root of the tree.

As explained in the JMX section, these components can be exported as JMX MBeans and therefore be accessible from JMX Consoles such as Java Missions Control (JMC).

Being able to take a snapshot of a Jetty component tree while it is running is the most useful information that can be attached when reporting an issue as it can contain both configuration and current state of Jetty. A dump of the component tree for the Server includes:

The thread pool configuration and its current state, including how many threads are in use, and their stack trace.
The Connector configuration (including TLS configuration), state and statistics.
The I/O configuration and its current state, including the ports Jetty listens to, how many connections are currently open, and he state of each connection, and the state of the request/response handling for each connection.
The Handler structure and its configuration.
The web applications deployed and their configurations, including the class loader information.

Component Dump at Server Start/Stop

You can get the server dump at any time using these methods.

Server server = new Server();
server.start();

// Get the server dump as a string.
String dumpString = server.dump();

// Or dump to standard error stream.
server.dumpStdErr();

However, it is often useful to configure the server to dump the state of the freshly started server, and also dump the state just before the Server stops (which may be useful to log the state of server that is not working properly).

Server server = new Server();

server.setDumpAfterStart(true);
server.setDumpBeforeStop(true);

server.start();

The format of the Jetty Server Dump output is subject to change at any time, as Jetty developers modify the Jetty code and decide to include more state, or remove state that is no longer relevant.

The Jetty Server Dump is organized in a tree whose structure is similar to the runtime Jetty component tree.

At the end of the dump output there is a legend that explains the type of tree node: whether it is a node that represent a managed component, or an array node (or a map node) that represent some component state, etc.

Obtaining Dump via JMX

The Jetty Component Dump can be obtained by invoking, via JMX, the Server.dump() operation, as shown below using Java Mission Control (JMC):

Find the Server MBean in the MBean Tree, under org.eclipse.jetty.server:type=server,id=0. Then click on the "Operations" tab, select the dump() operation, and then click the Execute button. In the bottom panel you will see the result of the invocation, that you can copy into a text editor and save to your file system.

Taking a Jetty Component Dump is a relatively expensive operation, as it dumps the state of all connections (which can be thousands), and the state of all threads.

The result of the invocation may produce a large string, possibly few MiB, that may impact the server memory usage.

Furthermore, dumping the state of the I/O Jetty components takes a little CPU time off the handling of the actual I/O, possibly slowing it down temporarily.

The slow-down caused by taking the Jetty Component Dump may be noticeable on highly loaded systems. However, it is typically a very small price to pay to obtain the information about the Jetty state that may be critical to the resolution of an issue.

Detailed ThreadPool Information

By default, the dump of the thread pool will only dump the topmost stack frame of each thread. It is possible to configure the thread pool to dump the whole stack trace for each thread; while this may be a little more expensive, it provides complete information about the state of each thread, which may be important to diagnose the issue.

See the threadpool module configuration for more information about how to configure the thread pool to dump detailed thread information.

Detailed thread pool information can also be turned on/off on-the-fly via JMX, by finding the ThreadPool MBean under org.eclipse.jetty.util.thread:type=queuedthreadpool,id=0, then selecting the detailedDump attribute and setting it to true. You can now perform the Server.dump() operation as explained above, and then set detailedDump back to false.

Dump Example

Below you can find a simple example of a Jetty Component Dump, with annotations for the principal components:

oejs.Server@32eff876{STARTING}[12.0.20-SNAPSHOT,sto=0] - STARTING (1)
+= QueuedThreadPool[qtp842326585]@3234e239{STARTED,4<=4<=200,i=2,r=-1,t=59949ms,q=0}[ReservedThreadExecutor@5bda8e08{capacity=1,threads=ThreadIdPool@1e800aaa{capacity=1}}] - STARTED (2)
|  +- org.eclipse.jetty.util.thread.ThreadPoolBudget@185a6e9
|  += ReservedThreadExecutor@5bda8e08{capacity=1,threads=ThreadIdPool@1e800aaa{capacity=1}} - STARTED
|  |  +~ QueuedThreadPool[qtp842326585]@3234e239{STARTED,4<=4<=200,i=2,r=-1,t=59947ms,q=0}[ReservedThreadExecutor@5bda8e08{capacity=1,threads=ThreadIdPool@1e800aaa{capacity=1}}] - STARTED
|  |  +- ThreadIdPool@1e800aaa{capacity=1}
|  +> threads size=4
|     +> qtp842326585-16 RUNNABLE tid=16 prio=5 SELECTING
|     +> qtp842326585-17-acceptor-0@69ccad1c-ServerConnector@618b19ad{HTTP/1.1, (http/1.1)}{0.0.0.0:8080} RUNNABLE tid=17 prio=3 ACCEPTING
|     +> qtp842326585-19 TIMED_WAITING tid=19 prio=5 IDLE
|     +> qtp842326585-18 TIMED_WAITING tid=18 prio=5 IDLE
+= oejut.ScheduledExecutorScheduler@60438a68{STARTED} - STARTED
+- org.eclipse.jetty.io.ArrayByteBufferPool@1fa121e2{min=0,max=65536,buckets=16,heap=0/118087680,direct=0/118087680}
|  +> direct size=16
|  |  +> org.eclipse.jetty.io.ArrayByteBufferPool$RetainedBucket@62ddbd7e[capacity=4096,in-use=0/0,pooled/acquires/releases=0/0/0(NaN%),non-pooled/evicts/removes=0/0/0]
|  |  +> org.eclipse.jetty.io.ArrayByteBufferPool$RetainedBucket@3857f613[capacity=8192,in-use=0/0,pooled/acquires/releases=0/0/0(NaN%),non-pooled/evicts/removes=0/0/0]
|  |  +> org.eclipse.jetty.io.ArrayByteBufferPool$RetainedBucket@198b6731[capacity=12288,in-use=0/0,pooled/acquires/releases=0/0/0(NaN%),non-pooled/evicts/removes=0/0/0]
|  |  +> org.eclipse.jetty.io.ArrayByteBufferPool$RetainedBucket@7c6908d7[capacity=16384,in-use=0/0,pooled/acquires/releases=0/0/0(NaN%),non-pooled/evicts/removes=0/0/0]
|  |  +> org.eclipse.jetty.io.ArrayByteBufferPool$RetainedBucket@3c9754d8[capacity=20480,in-use=0/0,pooled/acquires/releases=0/0/0(NaN%),non-pooled/evicts/removes=0/0/0]
|  |  +> org.eclipse.jetty.io.ArrayByteBufferPool$RetainedBucket@3bf7ca37[capacity=24576,in-use=0/0,pooled/acquires/releases=0/0/0(NaN%),non-pooled/evicts/removes=0/0/0]
|  |  +> org.eclipse.jetty.io.ArrayByteBufferPool$RetainedBucket@79079097[capacity=28672,in-use=0/0,pooled/acquires/releases=0/0/0(NaN%),non-pooled/evicts/removes=0/0/0]
|  |  +> org.eclipse.jetty.io.ArrayByteBufferPool$RetainedBucket@4d1c00d0[capacity=32768,in-use=0/0,pooled/acquires/releases=0/0/0(NaN%),non-pooled/evicts/removes=0/0/0]
|  |  +> org.eclipse.jetty.io.ArrayByteBufferPool$RetainedBucket@4b2bac3f[capacity=36864,in-use=0/0,pooled/acquires/releases=0/0/0(NaN%),non-pooled/evicts/removes=0/0/0]
|  |  +> org.eclipse.jetty.io.ArrayByteBufferPool$RetainedBucket@4e08711f[capacity=40960,in-use=0/0,pooled/acquires/releases=0/0/0(NaN%),non-pooled/evicts/removes=0/0/0]
|  |  +> org.eclipse.jetty.io.ArrayByteBufferPool$RetainedBucket@bcec361[capacity=45056,in-use=0/0,pooled/acquires/releases=0/0/0(NaN%),non-pooled/evicts/removes=0/0/0]
|  |  +> org.eclipse.jetty.io.ArrayByteBufferPool$RetainedBucket@26794848[capacity=49152,in-use=0/0,pooled/acquires/releases=0/0/0(NaN%),non-pooled/evicts/removes=0/0/0]
|  |  +> org.eclipse.jetty.io.ArrayByteBufferPool$RetainedBucket@302552ec[capacity=53248,in-use=0/0,pooled/acquires/releases=0/0/0(NaN%),non-pooled/evicts/removes=0/0/0]
|  |  +> org.eclipse.jetty.io.ArrayByteBufferPool$RetainedBucket@3d285d7e[capacity=57344,in-use=0/0,pooled/acquires/releases=0/0/0(NaN%),non-pooled/evicts/removes=0/0/0]
|  |  +> org.eclipse.jetty.io.ArrayByteBufferPool$RetainedBucket@40005471[capacity=61440,in-use=0/0,pooled/acquires/releases=0/0/0(NaN%),non-pooled/evicts/removes=0/0/0]
|  |  +> org.eclipse.jetty.io.ArrayByteBufferPool$RetainedBucket@2cd76f31[capacity=65536,in-use=0/0,pooled/acquires/releases=0/0/0(NaN%),non-pooled/evicts/removes=0/0/0]
|  +> direct non-pooled acquisitions size=0
|  +> indirect size=16
|  |  +> org.eclipse.jetty.io.ArrayByteBufferPool$RetainedBucket@5dda768f[capacity=4096,in-use=0/0,pooled/acquires/releases=0/0/0(NaN%),non-pooled/evicts/removes=0/0/0]
|  |  +> org.eclipse.jetty.io.ArrayByteBufferPool$RetainedBucket@7a8c8dcf[capacity=8192,in-use=0/0,pooled/acquires/releases=0/0/0(NaN%),non-pooled/evicts/removes=0/0/0]
|  |  +> org.eclipse.jetty.io.ArrayByteBufferPool$RetainedBucket@24269709[capacity=12288,in-use=0/0,pooled/acquires/releases=0/0/0(NaN%),non-pooled/evicts/removes=0/0/0]
|  |  +> org.eclipse.jetty.io.ArrayByteBufferPool$RetainedBucket@2aceadd4[capacity=16384,in-use=0/0,pooled/acquires/releases=0/0/0(NaN%),non-pooled/evicts/removes=0/0/0]
|  |  +> org.eclipse.jetty.io.ArrayByteBufferPool$RetainedBucket@24aed80c[capacity=20480,in-use=0/0,pooled/acquires/releases=0/0/0(NaN%),non-pooled/evicts/removes=0/0/0]
|  |  +> org.eclipse.jetty.io.ArrayByteBufferPool$RetainedBucket@3a52dba3[capacity=24576,in-use=0/0,pooled/acquires/releases=0/0/0(NaN%),non-pooled/evicts/removes=0/0/0]
|  |  +> org.eclipse.jetty.io.ArrayByteBufferPool$RetainedBucket@2a5c8d3f[capacity=28672,in-use=0/0,pooled/acquires/releases=0/0/0(NaN%),non-pooled/evicts/removes=0/0/0]
|  |  +> org.eclipse.jetty.io.ArrayByteBufferPool$RetainedBucket@752325ad[capacity=32768,in-use=0/0,pooled/acquires/releases=0/0/0(NaN%),non-pooled/evicts/removes=0/0/0]
|  |  +> org.eclipse.jetty.io.ArrayByteBufferPool$RetainedBucket@279fedbd[capacity=36864,in-use=0/0,pooled/acquires/releases=0/0/0(NaN%),non-pooled/evicts/removes=0/0/0]
|  |  +> org.eclipse.jetty.io.ArrayByteBufferPool$RetainedBucket@b3ca52e[capacity=40960,in-use=0/0,pooled/acquires/releases=0/0/0(NaN%),non-pooled/evicts/removes=0/0/0]
|  |  +> org.eclipse.jetty.io.ArrayByteBufferPool$RetainedBucket@45c7e403[capacity=45056,in-use=0/0,pooled/acquires/releases=0/0/0(NaN%),non-pooled/evicts/removes=0/0/0]
|  |  +> org.eclipse.jetty.io.ArrayByteBufferPool$RetainedBucket@2925bf5b[capacity=49152,in-use=0/0,pooled/acquires/releases=0/0/0(NaN%),non-pooled/evicts/removes=0/0/0]
|  |  +> org.eclipse.jetty.io.ArrayByteBufferPool$RetainedBucket@710f4dc7[capacity=53248,in-use=0/0,pooled/acquires/releases=0/0/0(NaN%),non-pooled/evicts/removes=0/0/0]
|  |  +> org.eclipse.jetty.io.ArrayByteBufferPool$RetainedBucket@1ff4931d[capacity=57344,in-use=0/0,pooled/acquires/releases=0/0/0(NaN%),non-pooled/evicts/removes=0/0/0]
|  |  +> org.eclipse.jetty.io.ArrayByteBufferPool$RetainedBucket@65e98b1c[capacity=61440,in-use=0/0,pooled/acquires/releases=0/0/0(NaN%),non-pooled/evicts/removes=0/0/0]
|  |  +> org.eclipse.jetty.io.ArrayByteBufferPool$RetainedBucket@61322f9d[capacity=65536,in-use=0/0,pooled/acquires/releases=0/0/0(NaN%),non-pooled/evicts/removes=0/0/0]
|  +> heap non-pooled acquisitions size=0
+~ org.eclipse.jetty.util.resource.FileSystemPool@6ad82709
+= oejsh.DefaultHandler@510f3d34{showContext=true,favIcon=true,STARTED} - STARTED
+= oejsh.ContextHandlerCollection@7817fd62{STARTED} - STARTED (3)
+= ServerConnector@618b19ad{HTTP/1.1, (http/1.1)}{0.0.0.0:8080} - STARTED (4)
|  +~ QueuedThreadPool[qtp842326585]@3234e239{STARTED,4<=4<=200,i=2,r=-1,t=59919ms,q=0}[ReservedThreadExecutor@5bda8e08{capacity=1,threads=ThreadIdPool@1e800aaa{capacity=1}}] - STARTED
|  +~ oejut.ScheduledExecutorScheduler@60438a68{STARTED} - STARTED
|  +~ org.eclipse.jetty.io.ArrayByteBufferPool@1fa121e2{min=0,max=65536,buckets=16,heap=0/118087680,direct=0/118087680}
|  += HttpConnectionFactory@1139b2f3[HTTP/1.1] - STARTED
|  |  +- HttpConfiguration@b2c9a9c{32768/8192,8192/8192,https://:0,[]}
|  |     +> customizers size=0
|  |     +> formEncodedMethods size=2
|  |     |  +> POST
|  |     |  +> PUT
|  |     +> outputBufferSize=32768
|  |     +> outputAggregationSize=8192
|  |     +> requestHeaderSize=8192
|  |     +> responseHeaderSize=8192
|  |     +> maxResponseHeaderSize=16384
|  |     +> headerCacheSize=1024
|  |     +> headerCacheCaseSensitive=false
|  |     +> secureScheme=https
|  |     +> securePort=0
|  |     +> idleTimeout=-1
|  |     +> sendDateHeader=false
|  |     +> sendServerVersion=true
|  |     +> sendXPoweredBy=false
|  |     +> delayDispatchUntilContent=true
|  |     +> persistentConnectionsEnabled=true
|  |     +> maxErrorDispatches=10
|  |     +> useInputDirectByteBuffers=true
|  |     +> useOutputDirectByteBuffers=true
|  |     +> minRequestDataRate=0
|  |     +> minResponseDataRate=0
|  |     +> httpCompliance=RFC7230[]
|  |     +> uriCompliance=DEFAULT[]
|  |     +> redirectUriCompliance=null
|  |     +> requestCookieCompliance=RFC6265@2362f559[INVALID_COOKIES, OPTIONAL_WHITE_SPACE, SPACE_IN_VALUES]
|  |     +> responseCookieCompliance=RFC6265@2362f559[INVALID_COOKIES, OPTIONAL_WHITE_SPACE, SPACE_IN_VALUES]
|  |     +> multiPartCompliance=RFC7578
|  |     +> notifyRemoteAsyncErrors=true
|  |     +> relativeRedirectAllowed=false
|  |     +> serverAuthority=null
|  |     +> localAddress=null
|  |     +> maxUnconsumedRequestContentReads=16
|  += ServerConnectorManager@4c178a76[keys=0] - STARTED
|  |  += oeji.ManagedSelector@247bddad{STARTED}[id=0 keys=0 selected=0 updates=0 selection:tot=0/avg=0.00/max=0] - STARTED (5)
|  |     += AdaptiveExecutionStrategy@7770f470/SelectorProducer@5e5d171f/PRODUCING/p=0/QueuedThreadPool[qtp842326585]@3234e239{STARTED,4<=4<=200,i=2,r=-1,t=59902ms,q=0}[ReservedThreadExecutor@5bda8e08{capacity=1,threads=ThreadIdPool@1e800aaa{capacity=1}}][pc=0,pic=0,pec=0,epc=0]@2025-04-03T21:59:48.476410815Z - STARTED
|  |     |  +- SelectorProducer@5e5d171f
|  |     |  +~ QueuedThreadPool[qtp842326585]@3234e239{STARTED,4<=4<=200,i=2,r=-1,t=59901ms,q=0}[ReservedThreadExecutor@5bda8e08{capacity=1,threads=ThreadIdPool@1e800aaa{capacity=1}}] - STARTED
|  |     +> updates @ 2025-04-03T21:59:48.468060469Z size=0
|  |     +> keys @ 2025-04-03T21:59:48.471668622Z size=0 (6)
|  +- sun.nio.ch.ServerSocketChannelImpl[]
|  +- qtp842326585-17-acceptor-0@69ccad1c-ServerConnector@618b19ad{HTTP/1.1, (http/1.1)}{0.0.0.0:8080}
+- org.eclipse.jetty.util.component.HaltLifeCycleListener@24313fcc
+- org.eclipse.jetty.server.Server$DynamicErrorHandler@7d20d0b
+> startJarLoader@4ee285c6 (7)
|  +> URLs size=8
|  |  +> file:/path/to/jetty.home-base/resources/
|  |  +> file:/path/to/jetty.home/lib/logging/slf4j-api-2.0.16.jar
|  |  +> file:/path/to/jetty.home/lib/logging/jetty-slf4j-impl-12.0.20-SNAPSHOT.jar
|  |  +> file:/path/to/jetty.home/lib/jetty-http-12.0.20-SNAPSHOT.jar
|  |  +> file:/path/to/jetty.home/lib/jetty-server-12.0.20-SNAPSHOT.jar
|  |  +> file:/path/to/jetty.home/lib/jetty-xml-12.0.20-SNAPSHOT.jar
|  |  +> file:/path/to/jetty.home/lib/jetty-util-12.0.20-SNAPSHOT.jar
|  |  +> file:/path/to/jetty.home/lib/jetty-io-12.0.20-SNAPSHOT.jar
|  +> parent: jdk.internal.loader.ClassLoaders$AppClassLoader@46faa73d
|     +> packages size=4
|     |  +> package org.eclipse.jetty.start.config
|     |  +> package org.eclipse.jetty.start.builders
|     |  +> package org.eclipse.jetty.start.shaded.util
|     |  +> package org.eclipse.jetty.start
|     +> parent: jdk.internal.loader.ClassLoaders$PlatformClassLoader@23348b5d
|        +> packages size=2
|           +> package sun.util.resources.provider
|           +> package sun.util.resources.cldr.provider
+> environments size=1
|  +> oejuc.Environment$Named@0{core}
|     +> startJarLoader@4ee285c6
|     |  +> URLs size=8
|     |  |  +> file:/path/to/jetty.home-base/resources/
|     |  |  +> file:/path/to/jetty.home/lib/logging/slf4j-api-2.0.16.jar
|     |  |  +> file:/path/to/jetty.home/lib/logging/jetty-slf4j-impl-12.0.20-SNAPSHOT.jar
|     |  |  +> file:/path/to/jetty.home/lib/jetty-http-12.0.20-SNAPSHOT.jar
|     |  |  +> file:/path/to/jetty.home/lib/jetty-server-12.0.20-SNAPSHOT.jar
|     |  |  +> file:/path/to/jetty.home/lib/jetty-xml-12.0.20-SNAPSHOT.jar
|     |  |  +> file:/path/to/jetty.home/lib/jetty-util-12.0.20-SNAPSHOT.jar
|     |  |  +> file:/path/to/jetty.home/lib/jetty-io-12.0.20-SNAPSHOT.jar
|     |  +> parent: jdk.internal.loader.ClassLoaders$AppClassLoader@46faa73d
|     |     +> packages size=4
|     |     |  +> package org.eclipse.jetty.start.config
|     |     |  +> package org.eclipse.jetty.start.builders
|     |     |  +> package org.eclipse.jetty.start.shaded.util
|     |     |  +> package org.eclipse.jetty.start
|     |     +> parent: jdk.internal.loader.ClassLoaders$PlatformClassLoader@23348b5d
|     |        +> packages size=2
|     |           +> package sun.util.resources.provider
|     |           +> package sun.util.resources.cldr.provider
|     +> Attributes core size=0
+> attributes size=0
+> org.eclipse.jetty.util.resource.FileSystemPool@6ad82709
   +> buckets size=0
key: +- bean, += managed, +~ unmanaged, +? auto, +: iterable, +] array, +@ map, +> undefined (8)
JVM: Eclipse Adoptium OpenJDK 64-Bit Server VM 24+36; OS: Linux amd64 6.8.0-57-generic; Jetty: 12.0.20-SNAPSHOT; CPUs: 1; mem(free/total/max): 44/58/900 MiB
UTC: 2025-04-03T21:59:48.491618275Z; Etc/UTC: 2025-04-03T21:59:48.491618275Z

1	The `Server` instance at the root of the tree
2	The thread pool component
3	The root of the `Handler` structure
4	The connector listening on port `8080` for the HTTP/1.1 protocol
5	A selector component that manages connections
6	The connections currently managed by the selector component
7	The server `ClassLoader` and its classpath
8	The legend for the dump nodes