CSCI 8100 - Computational Intelligence

Instructor: Dr. Ashraf Saad

Topics

• Evolutionary Computing
• Swarm Intelligence
• Fuzzy Logic
• Artificial Neural Networks
• Artificial Immune Systems
• Bayesian Reasoning
• Support Vector Machines

Concepts

• Optimization
• Constrained, unconstrained optimization
• Parameter space, function space, and fitness space
• Local and global optima
• Multi-objective optimization
• Classification / Learning
• Classification (Supervised Learning)
• Clustering (Unsupervised Learning)
• Reinforcement Learning
• Control Systems
• Expert Systems

Tentative Schedule

Resources

General

Recommended Textbook

• Russell Eberhart and Yuhui Shi - Computational Intelligence: Concepts to Implementations (2007) [companion amazon]

Additional Textbooks

• Fakhreddine Karray and Clarence de Silva - Soft Computing and Intelligent Systems Design (2004) [companion amazon]
• Andries Engelbrecht - Computational Intelligence: an Introduction (2007) [companion amazon]
• Amit Konar - Computational Intelligence: Principles, Techniques, and Applications (2005) [publisher link]
• Vojislav Kecman - Learning and Soft Computing: Support Vector Machines, Neural Networks, and Fuzzy Logic Models (2001) [link]

Journals

• Journal of Applied Soft Computing [link]
• Soft Computing - A Fusion of Foundations, Methodologies, and Applications [link]

Conferences

• IEEE Symposium Series on Computational Intelligence (IEEE SSCI) [2009]
• Online World Conference on Soft Computing in Industrial Applications (WSC) [2009]
• International Conference on Machine Learning and Applications (ICMLA) [2009]
• World Congress on Nature and Biologicaly Inspired Computing (NaBIC) [2009]
• International Conference on Hybried Intelligent Systems (HIS) [2009]

Courses

• Introduction to Computational Intelligence course at Indiana University Purdue University Indianapolis [slides]
• Intelligent Control course at University of British Columbia [slides]
• Computational Intelligence course at the University of Memphis [homepage]

Online Resources

• A Definition of Soft Computing [link]
• What is Intelligence? [link]
• Tutorials on Self-Organisation, Complexity and Artificial Life [link]

Software

• CIlib (Computational Intelligence Library) [info homepage]

Evolutionary Computing

Books

• Melanie Mitchell - An Introduction To Genetic Algorithms (1998) [link]
• John Koza - Genetic Programming II: Automatic Discovery of Reusable Programs (1994) [link]
• Zbigniew Michalewicz - Genetic Algorithms + Data Structures = Evolution Programs (1998) [link]

Journals

• IEEE Transactions on Evolutionay Computation [link]

Conferences

• Genetic and Evolutionary Computation Conference (GECCO) [2009 2010]
• IEEE Congress on Evolutionary Computation (IEEE CEC) [2009]

Papers

• Darrell Whitley - A Genetic Algorithm Tutorial (1993) [link ps]
• John Koza - Introduction to Genetic Programming: Tutorial (2004) [pdf]

Articles

• Discover Magazine - Evolving a Conscious Machine [link]

Online Resources

• Teaching genetic algorithm using MATLAB [link]

Courses

• Genetic Algorithms in Search, Optimization, and Machine Learning course at University of Illinois at Urbana-Champaign [website]
• Evolutionary Computation course at Michigan State University [website]

Software

• genetic (genetic algorithm framework for .NET) [homepage]
• JGAP (genetic algorithms and genetic programming framework for Java) [homepage]

Swarm Intelligence

Books

• James Kennedy, Russell Eberhart and Yuhui Shi - Swarm Intelligence (2001) [link]

Papers

• James Kennedy and Russell Eberhart - Particle Swarm Optimization (1995) [html]
• Frans van den Bergh - An Analysis of Particle Swarm Optimizers (2001) [ps.gz]

Online Resources

• swarmintelligence.org - Particle Swarm Optimization [link]

Fuzzy Logic

Journals

• IEEE Transactions on Fuzzy Systems [link]

Papers

• Lotfi Zadeh - Fuzzy Logic, Neural Networks, and Soft Computing (1994) [pdf] (requires ACM access)
• Jerry Mendel - Fuzzy Logic Systems for Engineering: A Tutorial (1995) [pdf]
• Jan Jantzen - Tutorial On Fuzzy Logic (1998) [pdf]

Online Resources

• Fuzzy Systems - A Tutorial [link]
• comp.ai.fuzzy newsgroup FAQ [link]
• Fuzzy Logic Tutorial [link]

Online Resources

• Free Fuzzy Logic Library [link]

Neural Networks

Books

• Christopher Bishop - Neural Networks for Pattern Recognition (1995) [link]

Conferences

• International Join Conference on Neural Networks (IJCNN) [2009]

Journals

• IEEE Transactions on Neural Networks [link]

Software

• Java Neural Network Simulator [link]
• Stuttgart Neural Network Simulator [link]
• PDP++ (neural-network simulation system written in C++) [link]

Immune Systems

Papers

• Clonal Selection Theory and CLONALG [pdf]

Bayesian Reasoning

Books

• Neapolitan - Learning Bayesian Networks [amazon]

Support Vector Machines

Books

• Vapnik - The Nature of Statistical Learning Theory [amazon]

Papers

• Christopher Burges - A Tutorial on Support Vector Machines for Pattern Recognition [pdf]
• Chih-Wei Hsu, Chih-Chung Chang, and Chih-Jen Lin - A Practical Guide to Support Vector Classficiation [pdf]

Software

• LIBSVM - A Library for Support Vector Machines [homepage]

Hybrids

• Wiggins et al. - Evolving a Bayesian classifier for ECG-based age classification in medical applications (2007) [sciencedirect]
• Saxena and Saad - Evolving an Artificial Neural Network Classifier for Condition Monitoring of Rotating Mechanical Systems (2005) [sciencedirect pdf]
• Chen et al. - Online hybrid traffic classifier for Peer-to-Peer systems based on network processors (2008) [sciencedirect]
• Gabrys and Ruta - Genetic algorithms in classifier fusion (2005) [sciencedirect]
• Yan et al. - A Multiple Classifier System for Aircraft Engine Fault Diagnosis (2006) [pdf]
• Baker and Abdul-Kareem - Soft Computing In Medicine: Nasopharangeal Carcinoma Prognosis (2005) [link]
• Li and Wang - A hybrid coevolutionary algorithm for designing fuzzy classifiers (2009) [sciencedirect]
• Goebel et al. - Information fusion of classifiers in systems with partial redundant information (2004) [pdf]
• Korbicz and Witczak - Soft Computing in Fault Detection and Isolation (2005) [pdf]
• Cho - Pattern Recognition with Neural Networks Combined by Genetic Algorithms (1999) [sciencedirect]
• Li, Bhanu, and Krawiec - Hybrid Coevolutionary Algorithms vs. SVM Algorithms (2007) [acm]
• Zmuda, Rizki, and Tamburino - Hybrid Evolutionary Learning for Synthesizing Multi-class Pattern Recognition Systems (2002) [sciencedirect]
• Hassanein and Abraham - An Overview of Rough-Hybrid Approaches in Image Processing (2008) [pdf]
• Zue, Chen, and Yang - Discriminative Regularization: A New Classifier Learning Method (2008) [pdf]
• Kudo and Sklansky - Comparison of Algorithms that Select Features for Pattern Classifiers (1999) [sciencedirect]
• Abraham - Adaptation of Fuzzy Inference System using Neural Learning (2005) [pdf]
• Abraham - Neuro Fuzzy Systems: State-of-the-art Modeling Techniques (2001) [citeseer]
• Chen et al. - Online Hybrid Traffic Classifier for Peer-to-Peer Systems Based on Network Processors (2008) [pdf]
• Saad - An Overview of Hybrid Soft Computing Techniques for Classifier Design and Feature SElection (2008) [ieee]
• Herrera et al. - Ten Years of Genetic Fuzzy Systems: Current Framework and New Trends (2001) [sciencedirect]
• Ragot and Anqutil - A Generic Hybrid Classifier Based on Hierarchical Fuzzy Modeling: Experiments on On-Line Handwritten Character Recognition (2003) [ieee citeseer]
• Roubos et al. - Learning Fuzzy Classification Rules from Data (2003) [pdf]
• Carse and Pipe - X-FCS: A Fuzzy Classifier System using Accuracy Based Fitness - First Results (2001) [ps]
• Akbarzadeh et al. - Soft Computing Paradigms for Hybrid Fuzzy Controllers: Experiments and Applications (1998) [pdf]
• Abraham - It is time to Fuzzify Neural Networks! (Tutorial) (2001) [citeseer]
• Vairappan et al. - Batch type local search-based adaptive neuro-fuzzy inference system (ANFIS) with self-feedbacks for time-series prediction (2008) [sciencedirect]
• Siddique and Tokhi - GA-based Neural Fuzzy Control of Flexible-link Manipulators (2006) [pdf]
• Almejalli et al. - GA-Based Learning Algorithms to Identify Fuzzy Rules for Fuzzy Neural Networks (2007) [ieee]
• Gacto et al. - Adaptation and application of multi-objective evolutionary algorithms for rule reduction and parameter tuning of fuzzy rule-based systemrs (2008) [pdf]
• Leng et al. - Design for Self-Organizing Fuzzy Neural Networks Based on Genetic Algorithms (2006) [ieee]
• Mucientes et al. - Design of a fuzzy controller in mobile robotics using genetic algorithms (2005) [sciencedirect]
• Spitzlinger and Mayer - Evolution of Fuzzy Controllers with Multi-Chromosomal Representation of Membership Functions (2003) [pdf]
• Tang et al. - GA-TSKfnn: Parameters tuning of fuzzy neural network using genetic algorithms (2005) [sciencedirect]
• Angelov - A fuzzy controller with evolving structure (2003) [sciencedirect]
• Akcayol - Application of adaptive neuro-fuzzy controller for SRM (2003) [sciencedirect]
• Linden and Bhaya - Evolving fuzzy rules to model gene expression (2006) [sciencedirect]
• Lughofer et al. - Evolving single- and multi-model fuzzy classifiers with FLEXFIS-class (2007) [pdf]
• Lughofer - On-line evolving image classifiers and their application to surface inspection (2009) [sciencedirect]
• Angelov et al. - Evolving fuzzy classifiers using different model architectures (2008) [sciencedirect]

Software

• NEFCON - Neuro-Fuzzy Control [homepage]
• Engineering Applications of Soft Computing [link]

Talks

• Hoffman - Boosting a Genetic Fuzzy Classifier (2001) [ppt]
• Wolkenhauer - Fuzzy Classification [pdf]

Application Areas

Evolutionary Robotics

• Nelson, Barlow and Doitsidis - Fitness functions in evolutionary robotics: A survey and analysis (2008) [sciencedirect]
• Liu, Wang, and Tan (eds.) - Design and Control of Intelligent Robotic Systems (2009) [website]
• Iba (ed.) - Frontiers in Evolutionary Robotics (2008) (Free book download) [website]
• Mautner - Simultaneous Evolution of Robot Control and Morphology (1998) [pdf]
• Alander - An Indexed Bibliography of Genetic Algorithms in Robotics (1998) [pdf]

Clustering

Papers

• Jain et al. - Data Clustering: A Review (1999) [pdf]
• Frey and Dueck - Clustering by Passing Messages Between Data Points (2007) [pdf]