Canada Spends Logo

Explore our Budget 2026 analysis

Grant: Collaborative Research and Development Grants

University of Ottawa

$68,000.00

Distributed crawling and security assessment of rich internet applications

FY 2013-14

Summary
Crawling Web applications is necessary to index their content, and perform automated tasks such as testing or security and accessibility assessments. In the case of Rich Internet Applications, there are additional challenges because the Web pages executed at the client side may contain powerful program fragments that may execute without being visible to the user. In an ongoing research project, we have developed methods and tools for crawling Rich Internet Applications in order to build a model of these applications. In this research project we will explore the possibility of increasing the speed of these crawling algorithms by performing concurrent crawls, that is, executing several crawling programs concurrently on different computers. We note that a web application scan, using current technology, may take several weeks for complex applications. On the other hand, many large organizations have access to easily provisioned throw-away on-demand computing resources. We plan to use concurrent execution platforms, such as cloud computing and/or peer-to-peer networks, for the crawling of RIAs. We plan to explore different concurrent architectures and different distributed algorithms for controlling the concurrent crawling activities. The main research issues are related to the way the crawling of different parts of the application will be distributed to the different crawling engines and how these engines communicate with one another in order to exchange the necessary information to coordinate their work and to avoid duplication and overloading of the infrastructure. We will also consider the use of a network of parallel crawling engines for purposes for which a single crawling engine is not sufficient, as for instance, testing an application under high load, e.g. a simulated distributed denial of service attack, or finding vulnerabilities based on race conditions. During the later part of the project, we plan also to study how white-box analysis can benefit from a cloud computing architecture, and how the distributed black-box crawling approach can be combined with white-box analysis of the application program in order to obtain a more complete model of the application.
Program
Collaborative Research and Development Grants
Location
Ontario, Canada
Recipient Type
Academia
Type
Grant
Source
NSERC's Awards Data

As published

Application id
419394-2011
Name nom
Bochmann, Gregor
Department département
Engineering, Faculty of
Organization id
28
Institution établissement
University of Ottawa
Province en
Ontario
Province fr
Ontario
Country en
CANADA
Country fr
CANADA
Fiscal year exercice financier
2013
Competition year année de concours
2011
Award amount
68000
Program id
CRDPJ
Program name en
Collaborative Research and Development Grants
Program name fr
Subventions de recherche et développement coopérative
Group en
Research partnerships programs
Group fr
Programmes de partenariat
Committee code
96
Committee name en
RPP Internal Decision Cttee
Committee name fr
Cté de décision interne - PPR
Area of application code
801
Area of application group en
Information and communication services
Area of application group fr
Services d'information et de télécommunications
Area of application en
Computer software
Area of application fr
Logiciel
Research subject code
2705
Research subject group en
Information technology
Research subject group fr
Technologie de l'information
Research subject en
Software and development
Research subject fr
Logiciels et développement
Partie
3
Nb partie
3
Application title
Distributed crawling and security assessment of rich internet applications
Keyword
NSERC
Application summary
Crawling Web applications is necessary to index their content, and perform automated tasks such as testing or security and accessibility assessments. In the case of Rich Internet Applications, there are additional challenges because the Web pages executed at the client side may contain powerful program fragments that may execute without being visible to the user. In an ongoing research project, we have developed methods and tools for crawling Rich Internet Applications in order to build a model of these applications. In this research project we will explore the possibility of increasing the speed of these crawling algorithms by performing concurrent crawls, that is, executing several crawling programs concurrently on different computers. We note that a web application scan, using current technology, may take several weeks for complex applications. On the other hand, many large organizations have access to easily provisioned throw-away on-demand computing resources. We plan to use concurrent execution platforms, such as cloud computing and/or peer-to-peer networks, for the crawling of RIAs. We plan to explore different concurrent architectures and different distributed algorithms for controlling the concurrent crawling activities. The main research issues are related to the way the crawling of different parts of the application will be distributed to the different crawling engines and how these engines communicate with one another in order to exchange the necessary information to coordinate their work and to avoid duplication and overloading of the infrastructure. We will also consider the use of a network of parallel crawling engines for purposes for which a single crawling engine is not sufficient, as for instance, testing an application under high load, e.g. a simulated distributed denial of service attack, or finding vulnerabilities based on race conditions. During the later part of the project, we plan also to study how white-box analysis can benefit from a cloud computing architecture, and how the distributed black-box crawling approach can be combined with white-box analysis of the application program in order to obtain a more complete model of the application.
University of Ottawa - $68,000 Grant (2013-14) | Canada Spends