Grant: Discovery Grants Program - Individual
University of Windsor
$28,000.00
Mining the Deep Web using Sampling and Deep Learning Techniques
EF 2022-23
Résumé
The deep web (or the hidden web) is the web that is hidden behind searchable interfaces. Unlike the surface web where pages can be browsed and hence downloaded in large scale, the access to the deep web is restricted. One common restriction is by queries via programmable Web APIs and web services. Many data sources, such as online social networks (OSNs), are examples of the deep web. They have a vast amount of data, but their access interface is restrictive and limited. Typically, they impose a quota for the queries we can send and data items we can retrieve per IP address. Discovering properties and patterns of the data hidden in the deep web is a challenging problem. Deep learning has been proven an effective approach to data mining tasks. It has been particularly successful in learning embeddings, i.e., short and dense continuous vector representations, for a variety of entities such as words, networks, and documents. Embeddings are essential for downstream data mining and machine learning tasks, such as classification, clustering, and recommendation. Embedding algorithms are data--hungry. Their success hinges on the availability of copious and pertinent training data. With the deep web, the training data are scarce, and may not be representative. We need to develop sampling techniques that can obtain pertinent data, and improve deep learning algorithms that can utilize the limited data. Humans learn not by reading all the text indexed by Google or GoogleScholar. Instead, we learn by sending pertinent queries, reading the returns, and sending new queries. Similarly, deep learning algorithms cannot and should not have all the text from Google or the entire social network from Facebook. Instead, there should be sampling-based deep learning algorithms that will learn from the deep web in an iterative process. The proposed research will approach the problem from two directions 1) Bottom-up from the deep web: we will study the sampling techniques that can be supported from real deep web sites such as Twitter; 2) Top-down from the deep learning: we will select several deep learning algorithms to study whether they can be approximated using samples from the deep web, and what kind of samples can improve the performance. We will start with neural network based representation learning, e.g., the state-of-the-art SN (Skipgram Negative Sampling) for text embedding and DeepWalk for graph embedding. After word embedding and node embedding, we will expand to document, linked document embedding, and author embeddings. The study will be conducted in two stages. In the first stage, we will evaluate our methods on our local academic search engine so that parameters can be controlled and ground truths are available. In the second stage, we will move on to real hidden data sources.
Programme
Discovery Grants Program - Individual
Bénéficiaire
Emplacement
Ontario, Canada
Type de bénéficiaire
Academia
Type
Grant
Source
NSERC's Awards Data
Tel que publié
Application id
RGPIN-2019-05350
Name nom
Lu, Jianguo
Department département
Computer Science, School of - Computer Science, School of
Organization id
37
Institution établissement
University of Windsor
Province en
Ontario
Province fr
Ontario
Country en
CANADA
Country fr
CANADA
Fiscal year exercice financier
2022
Competition year année de concours
2019
Award amount
28000
Program id
RGPIN
Program name en
Discovery Grants Program - Individual
Program name fr
Programme de subventions à la découverte - individuelles
Group en
DISCOVERY RESEARCH
Group fr
RECHERCHE AXÉE SUR LA DÉCOUVERTE
Committee code
1507
Committee name en
Computer Science
Committee name fr
Sciences informatiques
Area of application code
802
Area of application group en
Information and communication services
Area of application group fr
Services d'information et de télécommunications
Area of application en
Information systems and technology
Area of application fr
Systèmes d'information et technologie de l'information
Research subject code
2700
Research subject group en
Information technology
Research subject group fr
Technologie de l'information
Research subject en
Information technology
Research subject fr
Technologie de l'information
Installment
inst:4
Partie
1
Nb partie
5
Application title
Mining the Deep Web using Sampling and Deep Learning Techniques
Application summary
The deep web (or the hidden web) is the web that is hidden behind searchable interfaces. Unlike the surface web where pages can be browsed and hence downloaded in large scale, the access to the deep web is restricted. One common restriction is by queries via programmable Web APIs and web services. Many data sources, such as online social networks (OSNs), are examples of the deep web. They have a vast amount of data, but their access interface is restrictive and limited. Typically, they impose a quota for the queries we can send and data items we can retrieve per IP address. Discovering properties and patterns of the data hidden in the deep web is a challenging problem. Deep learning has been proven an effective approach to data mining tasks. It has been particularly successful in learning embeddings, i.e., short and dense continuous vector representations, for a variety of entities such as words, networks, and documents. Embeddings are essential for downstream data mining and machine learning tasks, such as classification, clustering, and recommendation. Embedding algorithms are data--hungry. Their success hinges on the availability of copious and pertinent training data. With the deep web, the training data are scarce, and may not be representative. We need to develop sampling techniques that can obtain pertinent data, and improve deep learning algorithms that can utilize the limited data. Humans learn not by reading all the text indexed by Google or GoogleScholar. Instead, we learn by sending pertinent queries, reading the returns, and sending new queries. Similarly, deep learning algorithms cannot and should not have all the text from Google or the entire social network from Facebook. Instead, there should be sampling-based deep learning algorithms that will learn from the deep web in an iterative process. The proposed research will approach the problem from two directions 1) Bottom-up from the deep web: we will study the sampling techniques that can be supported from real deep web sites such as Twitter; 2) Top-down from the deep learning: we will select several deep learning algorithms to study whether they can be approximated using samples from the deep web, and what kind of samples can improve the performance. We will start with neural network based representation learning, e.g., the state-of-the-art SN (Skipgram Negative Sampling) for text embedding and DeepWalk for graph embedding. After word embedding and node embedding, we will expand to document, linked document embedding, and author embeddings. The study will be conducted in two stages. In the first stage, we will evaluate our methods on our local academic search engine so that parameters can be controlled and ground truths are available. In the second stage, we will move on to real hidden data sources.