Academia.eduAcademia.edu

Outline

An Accelerator for Rule Induction in Fuzzy Rough Theory

2021, IEEE Transactions on Fuzzy Systems

https://doi.org/10.1109/TFUZZ.2021.3101935

Abstract

Rule-based classifier, that extract a subset of induced rules to efficiently learn/mine while preserving the discernibility information, plays a crucial role in human-explainable artificial intelligence. However, in this era of big data, rule induction on the whole datasets is computationally intensive. So far, to the best of our knowledge, no known method focusing on accelerating rule induction has been reported. This is first study to consider the acceleration technique to reduce the scale of computation in rule induction. We propose an accelerator for rule induction based on fuzzy rough theory; the accelerator can avoid redundant computation and accelerate the building of a rule classifier. First, a rule induction method based on consistence degree, called Consistence-based Value Reduction (CVR), is proposed and used as basis to accelerate. Second, we introduce a compacted search space termed Key Set, which only contains the key instances required to update the induced rule, to conduct value reduction. The monotonicity of Key Set ensures the feasibility of our accelerator. Third, a rule-induction accelerator is designed based on Key Set, and it is theoretically guaranteed to display the same results as the unaccelerated version. Specifically, the rank preservation property of Key Set ensures consistency between the rule induction achieved by the accelerator and the unaccelerated method. Finally, extensive experiments demonstrate that the proposed accelerator can perform remarkably faster than the unaccelerated rule-based classifier methods, especially on datasets with numerous instances.

References (46)

  1. Z. Pawlak, Rough sets: Theoretical aspects of reasoning about data, 9, Springer Science & Business Media, Berlin, Germany, 2012.
  2. Z. Pawlak, A. Skowron, Rough sets: some extensions, Inf. Sci. 177(1) (2007) 28-40.
  3. D.Dubois, H.Prade, Putting rough sets and fuzzy sets together, Intelligent Decision support, Handbook of applications and advances of the rough sets theory, Ed.by R. Slowinski, 1992 Kluwer Academic Publishers.
  4. D. Dubois, H. Prade, Rough fuzzy sets and fuzzy rough sets, Int. J. Gen. Syst. 17 (2-3) (1990) 191-209.
  5. A.Goli, H.K.Zare, R.T.Moghaddam, A.Sadeghieh, A comprehensive model of demand prediction based on hybrid artificial intelligence and metaheuristic algorithms: A case study in dairy industry,MPRA Paper, 2018.
  6. D.S. Yeung, D.G. Chen, E.C.C. Tsang, J. W.T. Lee, X. Z. Wang, On the generalization of fuzzy rough sets, IEEE Trans. Fuzzy Syst. 13 (2005) 343-361.
  7. S. Y. Zhao, E. C. C. Tsang, D.G. Chen, X.Z. Wang, Building a Rule- Based Classifier---A Fuzzy-Rough Set Approach, IEEE Trans. Knowl. Data Eng., 22(5)(2010) 624-638.
  8. L.A. Zadeh, Fuzzy sets, Inf. Control 8 (3) (1965) 338-353.
  9. G.J. Klir, B. Yuan, Fuzzy Logic: Theory and Applications, Prentice- Hall, Englewood CliIs, NJ, 1995.
  10. E.C.C. Tsang, D.G. Chen, D.S. Yeung, X.Z. Wang, J.W. Lee, Attributes reduction using fuzzy rough sets, IEEE Trans. Fuzzy Syst. 16 (5) (2008) 1130-1141.
  11. X.Z. Wang, C. R. Dong. Improving Generalization of Fuzzy IF-THEN Rules by Maximizing Fuzzy Entropy. IEEE Transactions on Fuzzy Systems, 17(3)(2019)556-567.
  12. C.H. Cheng, J.H. Yang. Fuzzy time-series model based on rough set rule induction for forecasting stock price, Neurocomput. 302 (2018) 33-45.
  13. J.Błaszczyński, R. Słowiński, M. Szeląg. Sequential covering rule induction algorithm for variable consistency rough set approaches. Inf. Sci. 181(5)(2011) 987-1002.
  14. Y.H Qian, J.Y. Liang, W. Pedrycz, C.Y. Dang, Positive approximation: an accelerator for feature reduction in rough set theory, Artif. Intell., 174 (9)(2010) 597-618.
  15. W. Wei, P. Song, J.Y. Liang, X.Y. Wu, Accelerating incremental attribute reduction algorithm by compacting a decision table, Int. J. Mach. Learn. Cybern., (2018) 1-19.
  16. M. Elkano, J.A. Sanz, E.Barrenechea, H. Bustince, M. Galar: CFM-BD: A Distributed Rule Induction Algorithm for Building Compact Fuzzy Models in Big Data Classification Problems. IEEE Trans. Fuzzy Syst. 28(1) (2020)163-177.
  17. A. Goli, H.K.Zare, R.Tavakkoli-Moghaddam, A.Sadeghieh. Application of robust optimization for a product portfolio problem using an invasive weed optimization algorithm. Number. Algebra, Control. Optim., 9(2) (2019)187-209.
  18. S.M.Pahlevan, S.Hosseini, A.Goli, Sustainable supply chain network design using products' life cycle in the aluminum industry. Environ. Sci. Pollut. Res., 1-25.
  19. M.T.Ribeiro,S.Singh,C.Guestrin. Why Should I Trust You: Explaining the Predictions of Any Classifier, ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. 2016:1135- 1144.
  20. J.J. Niu, C.C. Huang, J.H. Li, M. Fan, Parallel computing techniques for concept-cognitive learning based on granular computing, Int. J. Mach. Learn. Cybern., 9(11)(2018) 1785-1805.
  21. L.H.Kong,W.H.Qu,J.D.Yu, H.Zuo, G.H.Chen, F.Xiong, S.R. Pan, S.Y. Lin, M.K. Qiu, Distributed feature selection for big data using fuzzy rough sets. IEEE Trans. Fuzzy Syst., 28(5)(2019) 846-857.
  22. J.Y. Liang, F. Wang, C.Y. Dang, Y.H. Qian, Incremental approach to feature selection based on rough set theory. IEEE Trans. Knowl. Data Eng., 26 (2) (2014) 294-308.
  23. N.Shan, W.Ziarko, Data-based acquisition and incremental modification of classification rules, Comput. Intell.,11(2)(1995)357-370.
  24. Y.Y. Yang, D.G. Chen, H. Wang, X.Z. Wang, Incremental Perspective for Feature Selection Based on Fuzzy Rough Sets, IEEE Trans. Fuzzy Syst. 26(3)(2018) 1257-1273.
  25. J.Y. Liang, J.R. Mi, W. Wei, F. Wang, An accelerator for attribute reduction based on perspective of objects and attributes, Knowl. Based Syst., 44 (1) (2013) 90-100.
  26. W. S. Du, B. Q.Hu, Dominance-based rough fuzzy set approach and its application to rule induction. Eur. J. Oper. Res. 261(2)(2017) 690-703.
  27. Y.H Qian, J.Y. Liang, W. Pedrycz, C.Y. Dang, An efficient accelerator for attribute reduction from incomplete data in rough set framework, Pattern Recog., 44 (8) (2011) 1658-1670.
  28. A.Goli, B.Malmir. A Covering Tour Approach for Disaster Relief Locating and Routing with Fuzzy Demand. Int. J. Intell. Transp. Syst. Res., 18(1)( 2020) 140-152.
  29. E.B.Tirkolaee, A. Goli, A.Faridnia, M.Soltani,G.W.Weber. Multi- objective optimization for the reliable pollution-routing problem with cross-dock selection using Pareto-based algorithms. J. Cleaner Production, 276(2020) 122927.
  30. A. Goli, E. B. Tirkolaee, N.S. Aydin. Fuzzy integrated cell formation and production scheduling considering automated guided vehicles and human factors. IEEE Trans. Fuzzy Syst., 2021.
  31. A. Goli, H. K. Zare, R. Tavakkoli-Moghaddam, A. Sadegheih. Multi- objective fuzzy mathematical model for a financially constrained closed- loop supply chain with labor employment. Comput. Intell., 36(1)(2020) 4-34.
  32. A. Goli, H.K. Zare, R. Tavakkoli-Moghaddam, A. Sadegheih. Hybrid artificial intelligence and robust optimization for a multi-objective product portfolio problem Case study: The dairy products industry. Computers & industrial engineering, 137(2019) 106090.
  33. S.Greco, B.Matarazzo, R. Slowinski, Rough sets theory for multicriteria decision analysis. Eur. J. Oper. Res., 129(1) (2001) 1-47.
  34. I. Cloete, J.V. Zyl. Fuzzy rule induction in a set covering framework. IEEE Trans. Fuzzy Syst.14.1(2006): 93-110.
  35. X.L. Wang, Q.C. Chen, D. S. Yeung, Mining Pinyin-to-character conversion rules from large-scale corpus: a rough set approach. IEEE Trans. Syst. Man Cybern. Part B 34(2)(2004) 834-844.
  36. X.Z.Wang, E.C.C.Tsang, S.Y. Zhao, D.G. Chen, D. S. Yeung, Learning fuzzy rules from fuzzy samples based on rough set technique. Inf. Sci. 177(20)(2007) 4493-4514.
  37. C. C. Huang, T. L. Tseng, Y. N. Fan, C. H. Hsu, "Alternative rule induction methods based on incremental object using rough set theory," Appl. Soft Comput., vol. 13, no. 1, pp. 372-389, 2013.
  38. H.M.Chen, T.R.Li, C. Luo, S.J.Hong, G.Y.Wang, A Rough Set-Based Method for Updating Decision Rules on Attribute Values' Coarsening and Reining. IEEE Trans. Knowl. Data Eng. 26(12) (2014) 2886-2899.
  39. B.Huang, D.K. Wei, H.X. Li, Y.L. Zhuang, Using a rough set model to extract rules in dominance-based interval-valued intuitionistic fuzzy information systems. Inf. Sci. 221(2013) 215-229.
  40. Y. Cheng. Forward approximation and backward approximation in fuzzy rough sets. Neurocomput., 148(2015) 340-353.
  41. D. Michie, D. J. Spiegelhalter, C. C. Taylor, Machine Learning, Neural and Statistical Classification. London, U.K.: Ellis Horwood, 1994.
  42. P. Clark and T. Niblett, The cn2 induction algorithm, Machine Learn., vol. 3, no. 4, pp. 261-283, Mar. 1989.
  43. G.Khayat,A.Langevin, D.Reopel, Integrated production and material handling scheduling using mathematical programming and constraint programming, Eur. J. Oper. Res., 175(3)(2006)1818-1832.
  44. J.Behnamian, S. Fatemi Ghomi, F. Jolai, O. Amirtaheri, Minimizing makespan on a three-machine flowshop batch scheduling problem with transportation using genetic algorithm, Applied Soft Comput., 12(2)(2012) 768-777.
  45. F.Doshi-Velez, B.Kim, Towards a rigorous science of interpretable machine learning, http://arxiv.org/abs /1702. 08608, 2017.
  46. A.Goli, H.Khademi-Zare, R. Tavakkoli-Moghaddam, A.Sadeghieh, R. M.Kordestanizadeh. An integrated approach based on artificial intelligence and novel meta-heuristic algorithms to predict demand for dairy products: a case study. Network Comp. Neu. Sys., 1(2021):1-35.