Analyzing TCP Dumps
Analyzing TCP dumps is very common use case when it comes to production support, since it is very useful and handy way to figure out network related issues. In this article I would like to walk you through that. Before start following this, you need to have thorough understanding of TCP/IP protocol suite. To quickly recap your TCP/IP knowledge you may refer to this. Also you need to have Wireshark packet sniffer tool installed in your system.
Scenario: Let’s invoke a simple currency converter web service with a sample SOAP request. Then we’ll capture the TCP dump and analyse it.
Before we start let me give you a brief introduction about TCP/IP suite. At the network layer, IP provides functions such as addressing, delivery, and datagram packaging, fragmentation and reassembly. At the transport layer, TCP and UDP are concerned with encapsulating user data and managing connections between devices. Other protocols provide routing and management functionality. Higher-layer protocols use these services, allowing them to concentrate on what they are intended to accomplish. Communication using TCP is said to be reliable because TCP keeps track of data that has been sent and received to ensure it all gets to its destination. UDP is an unreliable protocol. Also TCP connection is bidirectional.
Ok, here we go. I am going to use a reverse proxy written using HTTPCoreNIO to send a SOAP request to the backend currency converter service. Clone the project into your local file system and open it using whatever the IDE you are familiar with. Find the config.properties file resides under the src/main/resources directory and change the following properties as given.
Note: Leave keystore, keystorepassword, truststore and truststorepassword entries empty since we are not invoking any HTTPS/secure endpoint for the moment.
Then run the NHttpReverseProxy class using the IDE. The reverse proxy will listen for requests on port 8585. The reverse proxy is something similar to the ESB proxy except the fact that it does not conduct any mediation. It merely forwards the messages it gets to the backend service and sends the response back to the client.
We are going to send the following request to the currency converter web service. The WSDL definition for the service can be found here.
Copy the above request to a file and save it in your file system. Start the wireshark packet sniffer tool and give the following filter condition.
This is the IP address of the backend currency converter service which we are going to call.
Move into the directory where you have saved the sample SOAP request given above and use the following curl request to send the SOAP message to the reverse proxy.
curl -v -d @currencyReq.xml -H "Content-Type: text/xml; charset=utf-8" -H 'Host: www.webservicex.net' "SOAPAction:urn:ConversionRate" http://localhost:8585/currencyconvertor.asmx
Send around four such curl requests consecutively and a sample response is given below.
Then forcefully terminate the application using your IDE and save the TCP dump. A sample TCP dump which I have obtained can be found here.
Now it’s time for us to analyse this TCPdump.
Reverse Proxy resides on the machine with the IP address 192.168.1.100 where as the backend service resides on the machine with the IP address 126.96.36.199. I have extracted important parts from the TCPdump and shown below.
Connection Establishment using three-way handshake
Initially Reverse Proxy sends a [SYN] message to the backend service. Then the backend service replies with [SYN/ACK] and reverse proxy again [ACK] that. This is called as 3 way handshake TCP connection establishment process. Now a TCP connection is established between the two ends. The next step is data transferring phase.
Then probe down the TCPdump and identify the data transfer between the peers. Click on that particular row with HTTP/XML in the protocol column as shown in the image below and analyse it. You may identify the SOAP request sent above. The Reverse Proxy sends the SOAP request to the backend and the backend Acknowledges [ACK] it. Then you may see that the backend sends the response(200 OK) over HTTP/XML protocol and the Reverse proxy Acknowledges [ACK] it. Click on that response row and analyse the response which is similar to the one I have given above. Also note that HTTP/XML implies SOAP protocol. What we are doing here is sending XML data over HTTP application layer protocol.
The value in the sequence number field of a segment defines the number assigned to the first data byte contained in that segment.
The value of the acknowledgment field in a segment defines the number of the next byte a party expects to receive. The acknowledgment number is cumulative.
For an example, in my case I am taking first POST request which starts at sequence number 200 and TCP segment length is 311. You can get these information by merely analyzing the Transmission Control Protocol section under the selected row. Now the backend service has received up to 511 bytes and the next expected sequence number is 511, which is sent with the [ACK] segment. If the ACK is not received for this segment till the Retransmission timer expires, TCP merely retransmit the segment again. With TCP you may never loose your data.
Connection Termination using three-way handshake
All the way down you may see the TCP connection termination process. Since we terminated the Reverse proxy application forcefully after some time, the Reverse proxy starts an Active Close event and sends a [FIN] segment to the backend service. Then the backend service responds with [FIN/ACK] segment to the Reverse proxy which is a Passive Close. This [ACK] is for the previous [FIN] segment sent from the Reverse proxy, and a new [FIN] segment is sent out from the backend service to terminate the TCP connection from it’s end. Finally the reverse proxy sends an [ACK] segment and TCP connection is terminated/teared off. This is also a three way handshake connection termination process. Each TCP connection has two directions and each end of the connection is terminated separately.
TCP Keep Alive: Usually we are not terminating a TCP connection after each request/response cycle is over due to performance reasons. Creating a new TCP connection is costly especially when it comes to secure/HTTPS connections. So what we do is, reuse the same TCP connection, over multiple request/response cycles. This will improve the performance.
Piggybacking: If ACK, SYN, FIN is sent together with data, we call it as piggybacking. The term comes from tieing something on the back of a Pig and dispatching along with the beast. Nice terminology which is interesting after a weird session.
Default TCP Ports: Default TCP port for HTTP is 80, whereas default TCP port for HTTPS is 443.
There are lot of TCP/IP related concepts such as half-closed state, Reliability, Flow control, Congestion control etc. which I could not cover in this article. I will thoroughly recommend you to refer  in order to gain more knowledge about TCP/IP protocol suite.