Developing A Contextual Combinational Approach for Predictive Analysis of Users Mobile Phone Trajectory Data in LBSNs
محورهای موضوعی : Data MiningFatemeh Ghanaati 1 , Gholamhossein Ekbatanifard 2 , Kamrad Khoshhal Roudposhti 3
1 - Department of Computer Engineering, Rasht Branch, Islamic Azad University, Rasht, Iran
2 - Department of Computer Engineering, Lahijan branch, Islamic Azad University, Lahijan, Iran
3 - Department of Computer Engineering, Lahijan branch, Islamic Azad University, Lahijan, Iran
کلید واژه: LBSN, Trajectory data, Contextual Information, GRU,
چکیده مقاله :
Today, smartphones, due to their ubiquity, have become indispensable in human daily life. Progress in the technology of mobile phones has recently resulted in the emergence of several popular services such as location-based social networks (LBSNs) and predicting the next Point of Interest (POI), which is an important task in these services. The gathered trajectory data in LBSNs include various contextual information such as geographical and temporal contextual information (GTCI) that play a crucial role in the next POI recommendations. Various methods, including collaborating filtering (CF) and recurrent neural networks, incorporated the contextual information of the user’ trajectory data to predict the next POIs. CF methods do not consider the effect of sequential data on modeling, while the next POI prediction problem is inherently a time sequence problem. Although recurrent models have been proposed for sequential data modeling, they have limitations such as similarly considering the effect of contextual information. Nonetheless, they have a separate impact as well. In the current study, a geographical temporal contextual information-extended attention gated recurrent unit (GTCI-EAGRU) architecture was proposed to separately consider the influence of geographical and temporal contextual information on the next POI recommendations. In this research, the GRU model was developed using three separate attention gates to consider the contextual information of the user trajectory data in the recurrent layer GTCI-EAGRU architecture, including timestamp, geographical, and temporal contextual attention gates. Inspired by the assumption of the matrix factorization method in CF approaches, a ranked list of POI recommendations was provided for each user. Moreover, a comprehensive evaluation was conducted by utilizing large-scale real-world datasets based on three LBSNs, including Gowalla, Brightkite, and Foursquare. The results revealed that the performance of GTCI-EAGRU was higher than that of competitive baseline methods in terms of Acc@10, on average, by 42.11% in three datasets.
Today, smartphones, due to their ubiquity, have become indispensable in human daily life. Progress in the technology of mobile phones has recently resulted in the emergence of several popular services such as location-based social networks (LBSNs) and predicting the next Point of Interest (POI), which is an important task in these services. The gathered trajectory data in LBSNs include various contextual information such as geographical and temporal contextual information (GTCI) that play a crucial role in the next POI recommendations. Various methods, including collaborating filtering (CF) and recurrent neural networks, incorporated the contextual information of the user’ trajectory data to predict the next POIs. CF methods do not consider the effect of sequential data on modeling, while the next POI prediction problem is inherently a time sequence problem. Although recurrent models have been proposed for sequential data modeling, they have limitations such as similarly considering the effect of contextual information. Nonetheless, they have a separate impact as well. In the current study, a geographical temporal contextual information-extended attention gated recurrent unit (GTCI-EAGRU) architecture was proposed to separately consider the influence of geographical and temporal contextual information on the next POI recommendations. In this research, the GRU model was developed using three separate attention gates to consider the contextual information of the user trajectory data in the recurrent layer GTCI-EAGRU architecture, including timestamp, geographical, and temporal contextual attention gates. Inspired by the assumption of the matrix factorization method in CF approaches, a ranked list of POI recommendations was provided for each user. Moreover, a comprehensive evaluation was conducted by utilizing large-scale real-world datasets based on three LBSNs, including Gowalla, Brightkite, and Foursquare. The results revealed that the performance of GTCI-EAGRU was higher than that of competitive baseline methods in terms of Acc@10, on average, by 42.11% in three datasets.
[1] L. Huang, Y. Ma, Sh. Wang, Y. Liu, “An Attention-based Spatiotemporal LSTM Network for Next POI Recommendation”, Journal of IEEE Transactions on Services Computing, vol. 12, 2019, pp. 1-13.
[2] J. Manotumruksa, C. Macdonald, I. Ounis, “A Contextual Attention Recurrent Architecture for Context- Aware Venue Recommendation”, in 18th ACM SIGIR Conference on Research and Development in Information Retrieval, 2018, pp. 555-564.
[3] K. Kala, M. Nandhini,” Context Category Specific sequence aware Point of Interest Recommender System with Multi Gated Recurrent Unit”, Journal of Ambient Intelligence and Humanized Computing, 2019, https://doi.org/10.1007/s12652-019-01583-w.
[4] C. Liu, J. Liu, J. Wang, S. Xu, H. Han, Y. Chen, “An Attention-Based Spatiotemporal Gated Recurrent Unit Network for Point-of-Interest Recommendation”, International Journal of Geo-Information, vol. 8, No. 8, 2019, pp.355-373.
[5] S. Wang, Z. Bao, J. Culpepper, G. Cong, “A Survey on Trajectory Data Management, Analytics, and Learning”, ACM Computing Surveys, vol. 54, No.3, 2020, pp. 1-33.
[6] J. Feng Y. Li, C. Zhang, F. Sun, F. Meng, A. Guo, D. Jin, “DeepMove: Predicting Human Mobility with Attentional Recurrent Networks”, in 18th ACM IW3C2 Conference on International World Wide Web, 2018, pp. 1459-1468.
[7] Q. Guo, Z .Sun, J. Zhang, Y. Theng, “An Attentional Recurrent Neural Network for Personalized Next Location Recommendation”, in 34th ACM AAAI Conference on Artificial Intelligence, 2020, pp. 83-90.
[8] D.Yao,C. Zhang, J. Huang, J. Bi, “SERM: A Recurrent Model for Next Location Prediction in Semantic Trajectories”, in 17th ACM CIKM Conference on Information and Knowledge Management, 2017 ,pp. 2411-2414.
[9] L. Zhang, Z. Sun, J. Zhang, H. Kloeden, F. Klanner, “Modeling hierarchical category transition for next POI recommendation with uncertain check-ins”, Journal of Information Sciences, Elsevier, vol.515, 2019, pp. 169-190.
[10] L. Chang, W. Chen, J. Huang, Ch. Bin, W. Wang, “Exploiting multi-attention network with contextual influence for point-of-interest recommendation”, Journal of Applied Intelligence, vol. 51, 2021, pp. 1904–1917.
[11] L. Huang, Y. Ma, Y. Liu, K. He, “DAN-SNR: A Deep Attentive Network for Social-Aware Next Point-of-Interest Recommendation”, Journal of ACM Transactions on Internet Technology, Vol.21, No.2, 2020, pp. 1–27.
[12] G. Christoforidis, P. Kefalas, A. Papadopoulos, Y. Manolopoulos, “RELINE: Point-of-Interest Recommendations using Multiple Network Embeddings”, Journal of Knowledge and Information Systems, Vol. 63, No.4, 2019, pp. 791-817.
[13] J. Manotumruksa, C. Macdonald, I. Ounis, “A Deep Recurrent Collaborative Filtering Framework for Venue Recommendation”, in 17th ACM CIKM Conference on Information and Knowledge Management, 2017, pp. 1429-1438.
[14] D. Yang, D Zhang, V. Zheng, Z. Yu, “Modeling User Activity Preference by Leveraging User Spatial Temporal Characteristics in LBSNs”, Journal of IEEE Transactions on Systems, Man, and Cybernetics: Systems, Vol.45, No.1, 2014, pp. 129 – 142.
[15] M. Quadrana, P. Cremonesi, D. Jannach, “Sequence-Aware Recommender Systems”, Journal of ACM Computing Surveys, Vol.51, No.4, 201, pp. 1–36.
[16] Q. Cui, Y. Tang, S. Wu, L. Wang, “Distance2Pre: Personalized Spatial Preference for Next Point-of-Interest Prediction”, in PAKDD Conference on Knowledge Discovery and Data Mining, 2019, pp. 289-301.
[17] Q. Gao, F. Zhou, G. Trajcevski, K. Zhang, T. Zhong, F. Zhang, “Predicting Human Mobility via Variational Attention”, in IW3C2 Conference on International World Wide Web Conference Committee, 2019, pp. 2750–2756.
[18] A.Vaswani, N. Shazeer, N. Parmar, J. Uszkoreit, L. Jones, A. Gomez, L. Kaiser, and I. Polosukhin, “Attention Is All You Need”, in 31th NIPS Conference on Neural Information Processing System, 2017, pp. 5998-6008.
[19] Y. Chen, C. Long, G.Cong, C. Li, “Context-aware Deep Model for Joint Mobility and Time Prediction”,in 13th ACM WSDM Conference on Web Search and Data Mining, 2020, pp. 106-114.
[20] S. Rendle, C. Freudenthaler, Z. Gantner, L. Thieme, “BPR: Bayesian Personalized Ranking from Implicit Feedback”, in 25th ACM UAI Conference on Uncertainty in Artificial Intelligence, 2009, pp. 452–461.
[21] E.Cho, S. Myers, J. Leskovec, “Friendship and Mobility: User Movement in Location-Based Social Networks”, in 17th ACM KDD Conference on Knowledge Discovery and Data Mining, 2011, pp. 1082–1090.
[22] P. Zhao, H. Zhu, Y. Liu, J. Xu, F. Zhuang, V. Sheng, X. Zhou, “Where to Go Next: A Spatio-Temporal Gated Network for Next POI Recommendation”,. in 33th AAAI Conference on Artificial Intelligence, 2019, pp. 5877-5884.
[23] A M. Islam, M. M. Mohammad, S. S. Das, M. E. Ali, “A Survey on Deep Learning Based Point-Of-Interest (POI) Recommendations”, 2020, arXiv:2011.10187v1.
[24] C. Zheng, D. Tao, “Attention-Based Dynamic Preference Model for Next Point-of-Interest Recommendation”. in 15th Springer WASA Conference on Wireless Algorithms, Systems, and Applications, 2020, pp. 768–780.
[25] D. K. Bokde, Sh. Girase, D. Mukhopadhyay, “Role of Matrix Factorization Model in Collaborative Filtering Algorithm: A Survey”, International Journal of Advance Foundation and Research in Computer, vol.1, 2014, pp. 111-118.
[26] M. Gan, L. Gao, “Discovering Memory-Based Preferences for POI Recommendation in Location-Based Social Networks”, International Journal of Geo-Information (IJGI), Vol.8, No.6, 2019, pp. 279-294.
[27] X. Meng, J. Fang, “A Diverse and Personalized POI Recommendation Approach by Integrating Geo-Social Embedding Relations”, Journal of IEEE Access, Vol.8, 2020, pp. 226309- 226323.
[28] Q. Yuan, G. Cong, Z. Ma, A. Sun, N. Thalmann, “Time-aware Point-of-interest Recommendation”, in 36th ACM SIGIR Conference on Research and development in Information Retrieval, 2013, pp. 363–372.
[29] P. Wang, H. Wang, H. Zhang, F. Lu, S. Wu, “A Hybrid Markov and LSTM Model for Indoor Location Prediction”, Journal of IEEE Access, Vol.7, 2019, pp. 185928 – 185940.
[30] J. Li, G. Liu, C. Yan, C. Jiang, “LORI: A Learning-to-Rank-Based Integration Method of Location Recommendation”, IEEE Transactions on Computational Social Systems, Vol.6, No.3, 2019, pp. 430 – 440.
[31] L.Yao, Q. Z. Sheng, Y. Qin, X. Wang, A. Shemshadi, Q. He, “Context-aware Point-of-Interest Recommendation Using Tensor Factorization with Social Regularization”, in 38th.ACM SIGIR Conference on Research and Development in Information Retrieval, 2015, pp. 1007–1010.
[32] X. He, L. Liao, H. Zhang, L. Nie, X. Hu, T. Chua, “Neural collaborative filtering”, in 26th ACM IW3C2Conference on World Wide Web Conference Committee, 2017, pp. 173-182.
[33] Q. Liu, S.Wu, L. Wang, T. Tan, “Predicting the Next Location: A Recurrent Model with Spatial and Temporal Contexts”, in 30th ACM AAAI Conference, 2016 , pp. 194–200.
[34] S. Kumar, M.I. Nezhurina, “An ensemble classification approach for prediction of user’s next location based on Twitter data”, Journal of Ambient Intelligence and Humanized Computing, Vol.10, No. 11, 2018, pp. 4503-4513.
[35] Q. Liu, S. Wu, D. Wang, Z. Li, L. Wang, “Context-Aware Sequential Recommendation”, in ICDM Conference on Data Mining, IEEE, 2016, pp. 1053-1058.
[36] D. Bokde, S. Girase, D. Mukhopadhya, “Matrix Factorization Model in Collaborative Filtering Algorithms: A Survey”, Procedia Computer Science, Vol.49, 2015, pp. 136-146.
[37] D. Lian, Y. Wu, Y. Ge, X. Xie, E. Chen, “Geography-Aware Sequential Location Recommendation”, in 26th ACM ICGKDD Conference on Knowledge Discovery and Data Mining, 2020, pp. 2009–2019.
[38] K. Yang, J. Zhu, “Next POI Recommendation via Graph Embedding Representation from H-Deepwalk on Hybrid Network”, Journal of IEEE Access, Vol 7, 2019, pp. 171105 – 171113.
[39] D. P. Kingma, J.L. Ba, “A Method for Stochastic Optimization”, in International Conference for Learning Representations, 2015, arXiv:1412.6980v.
