Modeling and analysis of HTTP traffic

11th IEEE/ACM International Symposium on Modeling, Analysis and Simulation of Computer Telecommunications Systems, 2003. MASCOTS 2003., 2003

2003

The paper presents a modeling and evaluation study of the characteristics of SMTP and HTTP applications in terms of user behavior, nature of contents transferred and application layer protocol exchanges. Results are reported on measuring, modeling and analysis of application level traces collected, at client and server ends, from different environments such as university networks and commercial Frame Relay networks. The methodologies used for capturing traffic flows and for modeling are reported. Statistical models have been developed for diverse parameters of applications, which can be useful for building synthetic workloads for simulation and benchmarking purposes. Both applications possess a session oriented structure. Within each session, a number of transactions may occur, and this number has been modeled as well.

2000

When performance studies about proxy cache server systems are made, one of the most common difficulties is to identify and to obtain representative workloads. Traces have been used as traditional workload. Gathering traces imply a large amount of time. If a self-similar traffic generator could be used, this problem would be solved, therefore evaluation studies become faster and more flexible. This work contains two parts; first, we perform a study of the self-similar property of several characteristics of the arrival collected traces, such as response size pattern, elapsed request time pattern and so on. Secondly, we model a source and develop a self-similar traffic arrival pattern generator.

Proceedings of the 2001 ACM SIGMETRICS international conference on Measurement and modeling of computer systems - SIGMETRICS '01, 2001

We report the results of a large-scale empirical study of web traffic. Our study is based on over 500 GB of TCP/IP protocolheader traces collected in 1999 and 2000 (approximately one year apart) from the high-speed link connecting The University of North Carolina at Chapel Hill to its Internet service provider. We also use a set of smaller traces from the NLANR repository taken at approximately the same times for comparison. The principal results from this study are: (1) empirical data suitable for constructing traffic generating models of contemporary web traffic, (2) new characterizations of TCP connection usage showing the effects of HTTP protocol improvement, notably persistent connections (e.g., about 50% of web objects are now transferred on persistent connections), and new characterizations of web usage and content structure that reflect the influences of "banner ads," server load balancing, and content distribution. A novel aspect of this study is a demonstration that a relatively light-weight methodology based o n passive tracing of only TCP/IP headers and off-line analysis tools can provide timely, high quality data about web traffic. We hope this will encourage more researchers to undertake ongoing data collection and provide the research community with data about the rapidly evolving characteristics of web traffic.

The global Internet has seen tremendous growth in terms of nodes and user base as well as of types of applications. One of the most important consequences of this growth is related to an increased complexity of the traffic experienced in these networks. Each application has a set of unique characteristics in terms of its performance characteristics, its transactions as well as the way the transaction processing profile maps onto unique network resource requirements. In order to support Internet applications effectively, it is therefore important to understand and to characterise the application level transactions. Recent advances in high resolution traffic monitoring and analysis capabilities have enabled us to build up realistic models for diverse network applications. In this paper we report investigations of classical applications such as FTP, SMTP, and HTTP to evaluate end-to-end network performance requirements. Our results show the presence of a robust correlation structure in the traffic streams that has a fundamental bearing on the user perceived quality of the applications.

International Journal of Scientific and Research Publications (IJSRP), 2019

The Internet and computer networks make extensive use of protocols. This paper is mainly focused on HTTP which is one of the most important piece of application layer protocol. Application layer is the topmost layer in OSI and TCP/IP model. The general format of HTTP request and response messages in real world are analyzed and captured by Wireshark. The actions taken by the Web client and server as these messages are sent and received are simulated and monitored using Packet Tracer.

We report on a large-scale empirical study to create application-level models for TCP traffic generation in simulations and network test-beds. A novel aspect of the study is the development of a method to construct empirical application-level models for arbitrary client/server (request/response) application-level protocols based on an analysis of unidirectional traces of only the TCP/IP headers in the traffic generated by the applications. By analyzing large collections of application-specific traces from a number of sources, we are producing empirical distributions to populate stochastic models of HTTP, FTP, and SMTP. However, combined, these applications represent less than 50% of the observed TCP traffic on our campus. We are also investigating the use of cluster analysis to identify sets of statistically homogenous TCP connection traces. Once these clusters have been identified we can then model each cluster by fitting stochastic models to the set of TCP connections identified as belonging to that cluster. 1

2000

We discuss the performance effects of using per-transaction TCP connections for HTTP access, and the proposed optimizations of avoiding per-transaction re-connection and TCP slow-start restart overheads. We analyzed the performance penalties of the interaction of HTTP and TCP. Our observations indicate that the proposed optimizations do not affect Web access for the vast majority of users. Most users see end-to-end

Globally the internet has emerged as the key component for commercial and personal communication. As many devices that have emerged, the internet is still increasing in usage, its flexibility and versatility cannot be questioned. Hence there is always an expansion of the Internet and there will always be an expansion as technology is always evolving and there will be continuous utilization and traffic behavioral changes. Due to this diversity and the fast changing properties the Internet is a moving target. At present, the Internet is far from being well understood in its entirety. However, constantly changing Internet characteristics associated with both time and location make it imperative for the Internet community to understand the nature and behavior of current Internet traffic in order to support research and further development. Through the measurement and analysis of traffic, the Internet can be better understood. This research presents a successful Internet measurement process, providing guidelines for conducting passive network measurements. Recent large scale back bone traffic data is analyzed, revealing current deployment of protocol features on packet and flow level, including statistics about anomalies and misbehavior. A method to classify packet header data on transport level according to network application is proposed, resulting in complete traffic decomposition.

1998

The rapid growth of the World Wide Web in recent years has caused a significant shift in the composition of Internet traffic. Although past work has studied the behavior of TCP dynamics in the context of bulk-transfer applications and some studies have begun to investigate the interactions of TCP and HTTP, few have used extensive realworld traffic traces to examine the problem. This interaction is interesting because of the way in which current Web browsers use TCP connections: multiple concurrent short connections from a single host.