References on V&V of Knowledge-Based Systems

Author: Hermann Kaindl, Stefan Kramer (Siemens)

Reference: TN-703.1.0-WP1100-SOE

Date: 95-08-02

Distribution: Public

Copyright: 1995 The ViVa Consortium


References

W. R. Adrion, M. A. Branstad, and J. C. Cherniavsky. Validation, verification and testing of computer software. ACM Computing Surveys, 14(2):159-192, June 1982.

F. Allard. Software quality and artificial intelligence: Knowledge-based systems: Recommendations for the development life-cycle, WGS/FA/92.055, Issue 1.0, Version 1.0. European Space Agency (ESA/ESTEC/WGS), April 1993.

G. Antoniou. Verification and correctness issues for non monotonic KBs. In Proc. European Workshop on the Verification and Validation of Knowledge Based Systems (EUROVAV-95), Chambery, France, June 1995.

C. Assemat and A. Bonnet. Conceptualisation, coherence et validation d'une base de connaissances. In Proc. Les systemes experts et leurs applications, pages 299-320, Avignon, France, April 1986.

M. C. Ayel and J.-P. Laurent. SACCO - SYCOJET: Two different ways of verifying knowledge-based systems. In Proceedings of the ECAI-90 Workshop on Validation, Verification and Test of KBS, pages 63-76, Stockholm, Sweden, August 1990.

M. C. Ayel and J.-P. Laurent, editors. Validation, verification and test of knowledge-based systems. John Wiley & Sons, Chichester, England, 1991.

M. C. Ayel and R. A. Stalker. Mutants in the KBS testing process. In Proc. European Workshop on the Verification and Validation of Knowledge Based Systems (EUROVAV-95), pages 7-18, Chambery, France, June 1995.

M. C. Ayel and L. Vignollet. A common approach for verifying and testing knowledge-based systems. In J. J. P. Tsai, T. Weigert, and H.-C. Jang, editors, Artificial Intelligence and Software Engineering. World Scientific, 1993.

M. C. Ayel and L. Vignollet. SYCOJET and SACCO: Two tools for verifying expert systems. International Journal of Expert Systems - Research and Applications, 6(3):357-382, 1993.

D. Baughman, R. Gamble, and A. Murphy. Using formal specification to design verifiable expert systems from specifications. In Proc. Workshop on Validation and Verification of Knowledge-Based Systems, Twelfth National Conference on Artificial Intelligence (AAAI-94), Seattle, WA, July/August 1994.

I. Benbasat and J. S. Dhaliwal. A framework for the validation of knowledge acquisition. Knowledge Acquisition, 1(2):215-233, 1989.

A. Bendou. CT-DATAGEN: A constraint-based test data generator. In Proc. European Workshop on the Verification and Validation of Knowledge Based Systems (EUROVAV-95), pages 19-29, Chambery, France, June 1995.

R. W. Blanning. Knowledge acquisition and system validation in expert systems for management. Human System Management, 4(4):280-285, 1984.

D. C. Bochsler and M. A. Goodwin. A software engineering approach to expert system design and verification. In Proc. NASA/STID Conference on Artificial Intelligence for Space Applications, pages 47-60, Huntsville, AL, November 1986.

B. W. Boehm. Verifying and validating software requirements and design specifications. IEEE Software, 1(1):75-89, 1984.

F. Bouali and S. Loiseau. Rule base diagnosis for debugging: The KB-DIAGO2 system. In Proc. European Workshop on the Verification and Validation of Knowledge Based Systems (EUROVAV-95), Chambery, France, June 1995.

P. Boulitreau-Lefevre. Modelling validation seen as a set of solving tasks. In Proc. European Workshop on the Verification and Validation of Knowledge Based Systems (EUROVAV-95), Chambery, France, June 1995.

J. Brender, H. Larsen, B. Lopez, P. Meseguer, H. Nonfjall, E. Plaza, J. P. Vaudet, and P. Vesoul. Validation: State of the art. Deliverable No 1, 1989. ESPRIT II Project VALID.

F. Buratto and C. Chabaud. Les representations en jeu dans les activites de conception et de validation des SBC. In Actes des deuxiemes journees Validation des Systemes a Base de Connaissances - JVAL, Saint Raphael, France, 1993.

D. Canamero and S. Geldof. Coupling, modeling and validation in COMMET. In Proc. European Workshop on the Verification and Validation of Knowledge Based Systems (EUROVAV-93), Palma de Mallorca, Spain, 1993.

D. Canamero and S. Geldof. Modelisation et validation dans commet: Une integration des deux approches. In Actes des 4es Journees Acquisition des Connaissances, Saint Raphael, France, 1993.

C. L. Chang, J. B. Combs, and R. A. Stachowitz. A report on the expert system validation associate (EVA). Expert Systems with Applications, 1(3):217-230, 1990.

C. L. Chang, R. A. Stachowitz, and J. B. Combs. Validation of nonmonotonic knowledge-based systems. In A. Dollas, W. T. Tsai, and N. G. Bourbakis, editors, Proceedings of the 2nd International Conference on Tools for Artificial Intelligence (TAI-90), pages 776-782, Washington, DC, 1990. IEEE Computer Society.

L. A. Clarke and D. J. Richardson. Symbolic evaluation - an aid to testing and verification. Technical Report 83-41, University of Massachussets, 1983.

S. Cross and M. Grisoni. VORTEX: A methodology for producing validated real-time expert systems. In Conf. Knowledge-Based Systems, Applications for Guidance and Control. Proc. N. 474. NATO Advisory Group for Aerospace Research and Development, 1990.

J. E. Cuddigan, J. Norris, S. A. Ryan, and S. Evans. Validating the knowledge in a computer-based consultant for nursing care. In Proc. 11th Annual Symposium on Computer Applications in Medical Care (SCAMC-87), pages 74-78. IEEE Computer Society, November 1987.

J. B. Domingue. Software visualization based KBS validation. In Proc. European Workshop on the Verification and Validation of Knowledge Based Systems (EUROVAV-95), Chambery, France, June 1995.

D. Dubois and H. Prade. On the validation of fuzzy knowledge bases. In S. Tzafestas, editor, Fuzzy Reasoning in Information, Decision and Control Systems. Kluwer Academic Publ., 1993.

R. Enand, G. S. Kahn, and R. A. Mills. A methodology for validating large knowledge bases. International Journal of Man-Machine Studies, 30:361-371, 1990.

P. N. Finlay, G. J. Forsey, and J. M. Wilson. The validation of expert systems: Contrasts with traditional methods. Journal of the Operational Research Society, 39(10):933-938, 1988.

R. F. Gamble, G.-C. Roman, and W. E. Ball. Formal verification of pure production system programs. In Proc. Ninth National Conference on Artificial Intelligence (AAAI-91), pages 329-334, Anaheim, CA, July 1991. AAAI-Press, Menlo Park, CA.

R. F. Gamble, G.-C. Roman, and W. E. Ball. On extending the application of formal specification and verification methods to rule-based programming. Technical Report WUCS-91-1, Dep. of Computer Science, Washington University, St. Louis, MO, 1991.

G. Ganascia. Mirlitho: Validation des resultats et detection des contradictions dans les systemes de diagnostic. These de 3eme cycle, Universite de Paris-Sud, Paris, France, 1983.

J. R. Geissman and R. D. Schultz. Verification and validation of expert systems. AI Expert, pages 26-33, 1988.

S. Geyres. Une approche industrielle de la validation et de la verification des systemes a base de connaissances. Revue Genie Logiciel et Systemes Experts, 16:25-35, September 1989.

A. Ginsberg. Knowlegde-base reduction: A new approach to checking knowledge bases for inconsistency & redundancy. In Proc. Seventh National Conference on Artificial Intelligence (AAAI-88), pages 585-589. AAAI-Press, Menlo Park, CA, 1988.

C. J. R. Green and M. M. Keyes. Verification and validation of expert systems. In Proc. Western Conference on Expert Systems (WESTEX-87), pages 38-43, Anaheim, CA, June 1987. IEEE Computer Society.

M. Grisoni and P. Bentley. Vortex - tools and techniques for knowledge base validation. Logica ?, 1992.

P. Grogono, A. D. Preece, R. Shinghal, and C. Y. Suen. A survey of evaluation techniques used for expert systems in telecommunications. Expert Systems with Applications, 5:395-401, 1992.

U. G. Gupta, editor. Validating and Verifying Knowledge-Based Systems. IEEE Computer Society Press, Los Alamitos, CA, 1991.

D. Hamilton, K. Kelley, and C. Culbert. KBS V&V state-of-the-practice and implications for V&V standards. In Proc. Workshop KBS V&V, Ninth National Conference on Artificial Intelligence (AAAI-91), Anaheim, CA, July 1991.

D. Hamilton and K. Kelly. State-of-the-practice in knowledge-based system verification and validation. Expert Systems with Applications, 3:403-410, 1991.

C.-S. Haouche. Using a conceptual model to validate KBSs. In Proc. European Workshop on the Verification and Validation of Knowledge Based Systems (EUROVAV-93), Palma de Mallorca, Spain, 1993.

C.-S. Haouche. Utilisation des concepts de l'acquisition des connaissances pour valider un SBC. These de doctorat, Universite de Paris-Dauphine, Paris, France, 1995.

C.-S. Haouche and J. Charlet. Using a KADS inference structure to test a KBS behaviour. In Proc. European Workshop on the Verification and Validation of Knowledge Based Systems (EUROVAV-95), Chambery, France, June 1995.

K. Hinkelman, O. Kuhn, and H. Wache. Revising and updating a corporate memory. In Proc. European Workshop on the Verification and Validation of Knowledge Based Systems (EUROVAV-95), Chambery, France, June 1995.

J. Hoelter, G. Velay, and C. Rittano. Verification and validation in JHExpert. In Proc. European Workshop on the Verification and Validation of Knowledge Based Systems (EUROVAV-95), Chambery, France, June 1995.

E. Hollnagel. The formalization of knowledge-based systems validation and verification: Promises and pitfalls. In IFIP Transactions A (Computer Science and Technology), Vol. A-14, pages 220-230, Madrid, Spain, September 1992. IFIP 12th World Computer Congress.

E. Hollnagel. ViVa: A systematic approach to verification, improvement and validation of knowledge-based systems. Future Generation Computer Systems, 9(4):371-378, 1993.

T. Hoppe and P. Meseguer. On the terminology of VVT. In M. Grisoni, editor, Proc. European Workshop on the Verification and Validation of Knowledge Based Systems (EUROVAV-91), Cambridge, England, July 1991.

IEEE guide for the use of IEEE standard dictionary of measures to produce reliable software, Std. 982.2-1988, 1988.

D. Kinkielele. Un modele conceptuel pour la verification de la coherence des bases de connaissances floues. In Journees Francophones de Validation des Systemes a base de connaissances, Dourdan, France, April 1992.

D. Kinkielele. On the consistency of fuzzy knowledge bases. In Proceedings of the 2nd Symposion EUROVAV-93, pages 547-561, Palma de Mallorca, Spain, 1993.

D. Kinkielele. Abduction floue et verification dynamique des bases de connaissances. In Actes des 2e Rencontres Nationales des Jeunes Chercheurs en Intelligence Artificielle, Marseille, France, September 1994.

D. Kinkielele. Sur la verification de la coherence des bases de connaissances floues: Le systeme Flocon. These de doctorat, Universite de Savoie, Chambery, France, 1994.

D. Kinkielele. Validation des bases de connaissances floues: Detection des inconsistances potentielles. In Actes Congres 9e RFIA, Vol. 2, pages 1681-1687, Paris, France, January 1994.

D. Kinkielele and M. Ayel. On discovering potential inconsistencies in validating fuzzy knowledge bases. In Actes Congres 5e IPMU, pages 533-539, Paris, France, July 1994.

D. Kinkielele and M. Ayel. Un schema abductif pour la verification dynamique des bases de connaissances floues. In Proc. 2e CARI-94, Ouagadougou, Burkina-Faso, October 1994.

D. Kinkielele and M. C. Ayel. Methodes de verification des bases de connaissances floues. In Actes du 4e Congres sur les Applications des Ensembles Flous, Lille, France, December 1994.

P. Lafon. Methodes de verification de bases de connaissances. These de doctorat, Ecole nationale des ponts et chaussees, Chaussees, France, 1991.

H. L. Larsen and H. Nonfjall. Modeling in the design of a KBS validation system. International Journal of Intelligent Systems, 6(3):759-775, 1991.

J.-P. Laurent. First entries for the VIVA glossary. TN-610, November 1992.

J.-P. Laurent. Interpretative validation and objective validation: Towards a valid terminology for KBS validation, 1992.

J.-P. Laurent. Proposals for a valid terminology in KBS validation. In B. Neumann, editor, Proc. Tenth European Conference on Artificial Intelligence (ECAI-92), pages 829-834, Vienna, Austria, August 1992. John Wiley & Sons, Chichester, England.

J.-P. Laurent. Tutorial on validation of knowledge-based systems. In Tutorial Notes at Tenth European Conference on Artificial Intelligence (ECAI-92), Vienna, Austria, August 1992.

J.-P. Laurent. Vers une terminologie valide dans le domaine de la validation. In Actes des 3es Journees Acquisition des Connaissances, Dourdan, France, 1992.

J. P. Laurent and L. Vignollet. Aspects statiques et dynamiques des generateurs de cas de test. In Proc. JVAL-94, Strasbourg, France, March 1994.

J. P. Laurent and L. Vignollet. Static and/or dynamic test case generators. In Proc. The World Congress on Expert Systems, Lisbon, Portugal, January 1994.

S. C. Lee, M. Ratliff, C. Peterson, and L. F. Lollar. AMPERES: A real-time fault monitoring and diagnosis knowledge-based system for space power systems. Applied Artificial Intelligence, 5:281-308, 1991. Hemisphere Publishing Corporation.

P. Leemans. On the verification of knowledge in expert system modules. Master's thesis, Department of Mathematics & Computer Science, AI-Section, Vrije Universiteit, Amsterdam, The Netherlands, 1993.

P. Leemans, J. Treur, and M. Willems. On the verification of knowledge-based reasoning modules. Technical Report IR-346, Department of Mathematics & Computer Science, AI Group, Vrije Universiteit, Amsterdam, The Netherlands, 1993.

N. K. Liu and T. Dillon. An approach towards the verification of expert systems using numerical petri nets. International Journal of Intelligent Systems, 6:255-276, 1991.

S. Loiseau. Validation, acquisition et mise au point interactive des bases de connaissances: Le systeme COCO-X fonde sur la coherence. These de doctorat, Universite d'Orsay, Orsay, France, 1990.

S. Loiseau and M.-C. Rousset. Formal verification of knowledge bases focused on consistency: Two experiments based on ATMS techniques. International Journal of Expert Systems - Research and Applications, 6(3), 1993.

J. A. Long and I. M. Neale. Validating and testing in KBS - a case study. In Proc. Second International Conference on Industrial Engineering Applications of Artificial Intelligence and Expert Systems, pages 875-880, Tullahoma, TN, June 1989.

B. Lopez, P. Meseguer, and E. Plaza. Knowledge-based systems validation: A state of the art. AI Communications, 3(2):58-72, 1990.

R. Lopez De Mantaras, P. Kerdiles, and H. Larsen. Validation methods and tools for KBS systems: The VALID project. In Proc. of the 3rd International GI-Kongress. Springer Verlag Ed., 1989.

R. Lounis and M. Ayel. Completeness of knowledge-based systems. In Proc. European Workshop on the Verification and Validation of Knowledge Based Systems (EUROVAV-95), pages 31-46, Chambery, France, June 1995.

T. J. Lydiard. Overview of current practice and research initiatives for the verification and validation of KBS. The Knowledge Engineering Review, 7(2):101-113, June 1992.

B. Marcot. Testing your knowledge base. AI Expert, July 1987.

C. Martin-Mattei. ``Validation, Verification and Testing'': Procedures in the life cycle of knowledge-based systems. In M. Grisoni, editor, Proc. European Workshop on the Verification and Validation of Knowledge Based Systems (EUROVAV-91), Cambridge, England, July 1991.

O. J. Mengshoel. KVAT: A tool for incremental knowledge validation in a knowledge engineering workbench. In M. Grisoni, editor, Proc. European Workshop on the Verification and Validation of Knowledge Based Systems (EUROVAV-91), pages 133-146, Cambridge, England, July 1991.

O. J. Mengshoel. Knowledge validation: Principles and practice. IEEE Expert, pages 62-68, 1993.

P. Meseguer. Structural and performance metrics for rule-based expert systems. In M. Grisoni, editor, Proc. European Workshop on the Verification and Validation of Knowledge Based Systems (EUROVAV-91), Cambridge, England, July 1991.

P. Meseguer. Verification of multi-level rule-based expert systems. In Proc. Ninth National Conference on Artificial Intelligence (AAAI-91), pages 323-328, Anaheim, CA, July 1991. AAAI-Press, Menlo Park, CA.

P. Meseguer. Incremental verification of rule-based expert systems. In B. Neumann, editor, Proc. Tenth European Conference on Artificial Intelligence (ECAI-92), pages 840-844, Vienna, Austria, August 1992. John Wiley & Sons, Chichester, England.

P. Meseguer. Towards a conceptual framework for expert system validation. AI Communications, 5(3):119-135, 1992.

P. Meseguer. Expert system validation through knowledge base refinement. In R. Bajcsy, editor, Proc. Thirteenth International Joint Conference on Artificial Intelligence (IJCAI-93), pages 477-482, Chambery, France, August/September 1993. Morgan Kaufmann Publishers, San Mateo, CA.

E. F. Miller. Expert system validation: Issues and approaches. In Proc. Les Systemes Experts et leurs Applications, pages 233-236, Avignon, France, Mai 1987.

L. A. Miller. A comprehensive approach to the verification and validation of knowledge-based systems. In Proceedings of the IJCAI-89 Workshop on Validation, Verification and Test of KBS, Detroit, MI, August 1989.

L. L. Morell. Use of metaknowledge in the verification of knowledge-based systems. In Proc. of the IEAAEI, pages 847-857, June 1987.

D. L. Nazareth. Issues in the verification of knowledge in rule-based systems. International Journal of Man-Machine Studies, 30(3):255-271, 1989.

D. L. Nazareth and M. H. Kennedy. Verification of knowledge based systems using directed graphs. Knowledge Acquisition, 3:339-360, 1991.

T. A. Nguyen. Verifying consistency of production systems. In Proc. of the third Conference on Artificial Intelligence Applications, pages 4-8, Orlando, FL, 1987. IEEE Computer Society.

T. A. Nguyen, W. A. Perkins, T. J. Laffey, and D. Pecora. Checking an expert systems knowledge base for consistency and completeness. In Proc. Ninth International Joint Conference on Artificial Intelligence (IJCAI-85), pages 375-378, Menlo Park, CA, 1985. Morgan Kaufmann Publishers, San Mateo, CA.

T. A. Nguyen, W. A. Perkins, T. J. Laffey, and D. Pecora. Knowledge base verification. AI Magazine, 8(2):69-75, Summer 1987.

J. Norris, J. Cuddigan, and S. Ryan. Developing a method for validating the output of computerized expert systems in nursing. In A. M. McLane, editor, Proc. 7th Conference on Classification of Nursing Diagnoses, pages 160-167, St. Louis, MO, 1987. C. V. Mosby.

R. M. O'Keefe, O. Balci, and E. P. Smith. Validating expert system performance. IEEE Expert, 2(4):81-90, Winter 1987.

R. M. O'Keefe and D. E. O'Leary. The verification and validation of expert systems. In Proceedings of the IJCAI-89 Workshop on Validation, Verification and Test of KBS, Detroit, MI, August 1989.

D. E. O'Leary and N. A. Kandelin. Validating the weights in rule-based expert systems: A statistical approach. International Journal of Expert Systems, 1(3):253-279, 1988.

G. H. Palmer and S. Craw. Utilising explanation to assist the refinement of KBS. In Proc. European Workshop on the Verification and Validation of Knowledge Based Systems (EUROVAV-95), Chambery, France, June 1995.

L. F. Pau. Prototyping, validation and maintenance of knowledge based systems software. In Proc. 3rd Annual Expert Systems in Government Conference, pages 248-253, Washington, D.C., October 1987. IEEE Computer Society.

D. Pearce. A model based approach to validation. In M. Grisoni, editor, Proc. European Workshop on the Verification and Validation of Knowledge Based Systems (EUROVAV-91), pages 55-67, Cambridge, England, July 1991.

K. Pedersen. Well-structured knowledge-bases. AI Expert, April 1989.

W. A. Perkins, T. J. Laffey, D. Pecora, and T. A. Nguyen. Knowledge base verification. In G. Guida and C. Tasso, editors, Topics in Expert System Design, pages 353-376. Elsevier, North-Holland, Amsterdam, The Netherlands, 1989.

S. Petitjean, L. Brunessaux, and J.-P. Vaudet. Three pragmatic tools for the validation of knowledge based systems. In M. Grisoni, editor, Proc. European Workshop on the Verification and Validation of Knowledge Based Systems (EUROVAV-91), pages 111-123, Cambridge, England, July 1991.

R. T. Plant. On the verification, validation and testing of knowledge-based systems. Heuristics (Quarterly journal of the IAKE), 3(1):59-67, Spring 1990.

F. Polat and H. A. Guvenir. Knowledge base verification in an expert system shell. In Proceedings of the Fourth International Symposium on Computer and Information Sciences II, pages 889-898, Izmir, Turkey, 1988.

F. Polat and H. A. Guvenir. A unification-based approach for knowledge base verification. Expert Systems, 8(4):251-259, November 1991.

G. R. Prakash, E. Subramanian, and H. N. Mahabala. A methodology for systematic verification of OPS5-based AI applications. In J. Mylopoulos and R. Reiter, editors, Proc. Twelfth International Joint Conference on Artificial Intelligence (IJCAI-91), pages 3-8, Sydney, Australia, August 1991. Morgan Kaufmann Publishers, San Mateo, CA.

A. D. Preece. Verification of rule-based expert systems in wide domains. In N. Shadbolt, editor, Research and Development in Expert Systems VI: Proc. Expert Systems 89, pages 66-77, London, England, September 1989. British Computer Society Specialist Group on Expert Systems, Cambridge University Press.

A. D. Preece. Towards a methodology for evaluating expert systems. Expert Systems, 7(4):215-223, November 1990.

A. D. Preece. Verifying expert systems using conceptual models. In Proceedings of 5th Annual Knowledge-Based Software Assistant (KBSA) Conference, pages 280-289, Griffiss AFB, NY, 1990. New York: Rome Air Development Center.

A. D. Preece. Methods for verifying expert system knowledge bases. Technical report, Bell Canada, Centre for Pattern Recognition and Machine Intelligence, Concordia University, Montreal, Canada, 1991.

A. D. Preece. On the role of formal specifications in verification and validation of knowledge-based systems. In Proc. Workshop on Modelling Languages for Knowledge-Based Systems, Vrije Universiteit Amsterdam, The Netherlands, January 1995.

A. D. Preece, R. D. Bell, and C. Y. Suen. Experiences in using an expert system verification tool. In Proceedings of 1991 Bell Canada Quality Engineering Workshop, Ottawa, Canada, 1991.

A. D. Preece, R. D. Bell, and C. Y. Suen. Verifying knowledge based by anomaly detection: An experience report. In Proc. Workshop on Validation, Verification and Test of KBS, Tenth European Conference on Artificial Intelligence (ECAI-92), Vienna, Austria, August 1992.

A. D. Preece, R. D. Bell, and C. Y. Suen. Verifying knowledge-based systems using the Cover tool. In Proc. IFIP-92, Madrid, Spain, 1992.

A. D. Preece, C. Grossner, P. G. Chander, and T. Radhakrishnan. Structural validation of expert systems: Experience using a formal model. In Proc. Workshop on Validation and Verification of Knowledge-Based Systems, Eleventh National Conference on Artificial Intelligence (AAAI-93), Washington, DC, July 1993.

A. D. Preece, C. Grossner, and T. Radhakrishnan. Validating RBS that operate with incomplete data. In Proc. European Workshop on the Verification and Validation of Knowledge Based Systems (EUROVAV-95), Chambery, France, June 1995.

A. D. Preece and R. Shinghal. Practical approach to knowledge base verification. In M. Trivedi, editor, Proceedings of the Applications of Artificial Intelligence IX, pages 608-619, Bellingham, WA, 1991. Society of Photo-optical Instrumentation Engineers and International Society of Optical Engineers (SPIE).

A. D. Preece and R. Shinghal. Verifying knowledge bases by anomaly detection: An experience report. In B. Neumann, editor, Proc. Tenth European Conference on Artificial Intelligence (ECAI-92), pages 835-839, Vienna, Austria, August 1992. John Wiley & Sons, Chichester, England.

A. D. Preece and R. Shinghal. Foundation and application of knowledge base verification. International Journal of Intelligent Systems, 9(8):683-701, 1994.

A. D. Preece, R. Shinghal, and A. Batarekh. Principles and practice in verifying rule-based systems. The Knowledge Engineering Review, 7(2):115-141, June 1992.

A. D. Preece, R. Shinghal, and A. Batarekh. Verifying expert systems: A logical framework and a practical tool. Expert Systems with Applications, 5:421-436, 1992.

A. D. Preece, R. Shinghal, and P. Grogono. A perspective on validation of expert systems. Technical report, Bell Canada, Centre for Pattern Recognition and Machine Intelligence, Concordia University, Montreal, Canada, June 1991.

D. S. Prerau, A. S. Gunderson, R. E. Reinke, and S. K. Goyal. The COMPASS expert system: Verification, technology transfer and expansion. In Proceedings of the 2nd Conference on Artificial Intelligence Applications: The Engineering of Knowledge-Based Systems, pages 597-602, Washington, DC, 1985. IEEE Computer Society.

A. Rabelo, A. R. Rocha, A. D. de Souza, A. A. Ximenez, Lobo N., D. Carvalho, J. W. Filho, K. M. de Oliveira, L. A. de Souza, and V. Werneck. An expert system for diagnosis of acute myocardal infarction: Software quality assurance procedures. In Proc. European Workshop on the Verification and Validation of Knowledge Based Systems (EUROVAV-95), pages 173-187, Chambery, France, June 1995.

L. Raedt and M. Bruynooghe. Using interactive concept-learning for knowledge base validation, verification and testing. In Proceedings of the ECAI-90 Workshop on Validation, Verification and Test of KBS, Stockholm, Sweden, August 1990.

M.-C. Rousset. Sur la coherence et la validation des bases de connaissances: Le systeme COVADIS. These d'etat, Universite d'Orsay, Orsay, France, September 1988.

M.-C. Rousset. Knowledge formal specifications for formal verification: A proposal based on the integration of different logical formalisms. In A. G. Cohn, editor, Proc. Eleventh European Conference on Artificial Intelligence (ECAI-94), pages 739-743, Amsterdam, The Netherlands, August 1994. John Wiley & Sons, Chichester, England.

J. G. Schmolze and W. Snyder. A tool for testing confluence of production rule systems. In Proc. European Workshop on the Verification and Validation of Knowledge Based Systems (EUROVAV-95), Chambery, France, June 1995.

N. Shadbolt. Building valid knowledge bases: An acknowledge perspective. In Proceedings of the European Workshop on Verification, Validation and Testing of KBS, pages 195-210, 1991.

M. Snaprud and H. Kaindl. Knowledge acquisition using hypertext. Expert Systems with Applications: An International Journal, 5(3/4):369-375, 1992.

M. Snaprud and H. Kaindl. Types and inheritance in hypertext. International Journal of Human-Computer Studies, 41(1/2):223-241, July/August 1994.

J. T. St Johanser and R. M. Harbidge. Validating expert systems: Problems and solutions in practice. In Proc. of the Int. Conf. KBS 86, pages 215-229, London, England, October 1986.

R. A. Stachowitz, C. L. Chang, T. S. Stock, and J. B. Combs. Building validation tools for knowledge based systems. In Proceedings of the SOAR Conference, Houston, TX, 1987. NASA/JSC.

R. A. Stachowitz and J. B. Combs. Validation of expert systems. In Proc. 20th Annual Hawaii International Conference on System Sciences, Vol. 1, pages 686-695, 1987.

R. A. Stachowitz, J. B. Combs, and C. L. Chang. Validation of knowledge-based systems. In Proc. 2nd AIAA/NASA/USAF Symposium on Automation, Robotics and Advanced Computing for the National Space Program, Report No. AIAA-87-1685, pages 1-10, 1987.

R. A. Stachowitz, J. B. Combs, and C. L. Chang. Validation of knowledge-based systems: EVA. Machine intelligence and autonomy for aerospace systems, Vol. II, American Institute of Aeronautics and Astronomics, 1988.

R. Straatman and P. Beys. A performance model for KBS. In Proc. European Workshop on the Verification and Validation of Knowledge Based Systems (EUROVAV-95), Chambery, France, June 1995.

C. Y. Suen, P. D. Grogono, R. Shinghal, and F. Coallier. Verifying, validating and measuring the performance of expert systems. Expert Systems with Applications, 1(2):93-102, June 1990.

M. Suwa, A. C. Scott, and E. H. Shortliffe. An approach to verifying completeness and consistency in a rule-based expert system. AI Magazine, 3(4):16-21, Fall 1982.

S. Talbot. Verification de la coherence dans les systemes a base de conaissance avec gestion des execeptions. These de l'universite de savoie - LIA, Chambery, France, March 1991.

S. Talbot and M. Ayel. SACKOOL: Un systeme de detection des incoherences pour une validation des bases de connaissances. In Actes Congres RFIA, pages 1633-1646, Paris, France, December 1989.

B. S. Todd. Idempotency as a correctness property of rule bases. In Proc. European Workshop on the Verification and Validation of Knowledge Based Systems (EUROVAV-95), Chambery, France, June 1995.

J. Treur and M. Willems. A logical foundation for verification. In A. G. Cohn, editor, Proc. Eleventh European Conference on Artificial Intelligence (ECAI-94), pages 745-749, Amsterdam, The Netherlands, August 1994. John Wiley & Sons, Chichester, England.

J. Treur and M. Willems. On verification in compositional knowledge-based systems. In Proceedings of the ECAI-94 Workshop on Validation of Knowledge-Based Systems, Amsterdam, The Netherlands, August 1994.

J. Treur and M. Willems. Formal notions for verification of dynamics of KBS. In Proc. European Workshop on the Verification and Validation of Knowledge Based Systems (EUROVAV-95), Chambery, France, June 1995.

Validation methods and tools for knowledge-based systems. Deliverable, 1988. ESPRIT II VALID Project 2148.

VALID: VETA definition. Report Deliverable D4, 1991. ESPRIT II Project 2148.

F. van Harmelen and M. Aben. Applying rule-base anomalies to KADS inference structures. In R. Gamble, editor, Proceedings of the IJCAI-95 Workshop on Validation and Verification of Knowledge-Based Systems, Montreal, Canada, August 1995.

M. van Someren. Structural and formative validation of knowledge bases. In M. Grisoni, editor, Proc. European Workshop on the Verification and Validation of Knowledge Based Systems (EUROVAV-91), pages 103-108, Cambridge, England, July 1991.

J. Vanthienen, A. Aerts, C. Mues, and G. Wets. An modelling approach to KBS verification. In Proc. European Workshop on the Verification and Validation of Knowledge Based Systems (EUROVAV-95), Chambery, France, June 1995.

A. Vermesan and S. Meldhal. An algebraic approach to refinement of KBS specification. In Proc. European Workshop on the Verification and Validation of Knowledge Based Systems (EUROVAV-95), Chambery, France, June 1995.

C. Vicat, P. Brezillon, and C. Nottola. Knowledge validation in the building of a KBS. In Proc. European Workshop on the Verification and Validation of Knowledge Based Systems (EUROVAV-93), Palma de Mallorca, Spain, 1993.

L. Vignollet and R. Lelouche. Test case generation using KBS strategy. In R. Bajcsy, editor, Proc. Thirteenth International Joint Conference on Artificial Intelligence (IJCAI-93), pages 483-488, Chambery, France, August/September 1993. Morgan Kaufmann Publishers, San Mateo, CA.

B. Wendler. Calcul de labels pour des BC modulaires. In Secondes Rencontres Nationales des Jeunes Chercheurs en IA, page 308, Marseille, France, September 1994. Poster.

B. Wendler and M. C. Ayel. Verifying dynamic coherence in modular knowledge bases. In Proc. European Workshop on the Verification and Validation of Knowledge Based Systems (EUROVAV-95), pages 173-187, Chambery, France, June 1995.

B. Wendler and L. Vignollet. Verification of modular knowledge bases. In Proc. Workshop on Validation, Verification and Test of KBS, Eleventh European Conference on Artificial Intelligence (ECAI-94), Amsterdam, The Netherlands, August 1994.

B. Wendler, L. Vignollet, and S. Talbot. Computing partial labels in KBS validation tools. In Proc. European Symposium on the Validation and Verification of Knowledge Based Systems, pages 129-141, Palma de Mallorca, Spain, March 1993.

B. J. Wielinga and H. Akkermans and G. Schreiber. Validation and verification of knowledge models. In Proc. European Workshop on the Verification and Validation of Knowledge Based Systems (EUROVAV-93), Palma de Mallorca, Spain, 1993.

R. R. Yager and H. L. Larsen. On discovering potential inconsistences in validating knowledge bases by reflecting to input. IEEE Trans. on Systems, Man and Cybernetics, 1991.

N. Zlatareva. Distributed verification and automated generation of test cases. In Proceedings of the IJCAI-93 Workshop on Verification and Validation of Expert Systems, Chambery, France, August/September 1993.

N. Zlatareva and A. D. Preece. State of the art in automated validation of knowledge-based systems. International Journal of Expert Systems - Research and Applications, 1993.

Last Modified: 05:16pm MET, January 26, 1996