Semantic Multimedia and Ontologies · Yiannis Kompatsiaris Paola Hobson Editors Semantic Multimedia and Ontologies Theory and Applications Editors YiannisKompatsiaris,DiplEng,PhD PaolaHobson,BSc,PhD,MBA InformaticsandTelematicsInstitute CharteredEngineer Thermi-Thessaloniki MotorolaLabs Greece Basingstoke UK ISBN:978-1-84800-075-9 e-ISBN:978-1-84800-076-6 BritishLibraryCataloguinginPublicationData AcataloguerecordforthisbookisavailablefromtheBritishLibrary LibraryofCongressControlNumber:2007941392 (cid:2)c Springer-VerlagLondonLimited2008 Apart from any fair dealing for the purposes of research or private study, or criticism or review, as permittedundertheCopyright,DesignsandPatentsAct1988,thispublicationmayonlybereproduced, stored or transmitted, in any form or by any means, with the prior permission in writing of the publishers,orinthecaseofreprographicreproductioninaccordancewiththetermsoflicencesissued bytheCopyrightLicensingAgency.Enquiriesconcerningreproductionoutsidethosetermsshouldbe senttothepublishers. Theuseofregisterednames,trademarks,etc.,inthispublicationdoesnotimply,evenintheabsenceofa specificstatement,thatsuchnamesareexemptfromtherelevantlawsandregulationsandthereforefree forgeneraluse. Thepublishermakesnorepresentation,expressorimplied,withregardtotheaccuracyoftheinformation containedinthisbookandcannotacceptanylegalresponsibilityorliabilityforanyerrorsoromissions thatmaybemade. Printedonacid-freepaper 9 8 7 6 5 4 3 2 1 SpringerScience+BusinessMedia springer.com Acknowledgments This work was partially supported by the European Commission under contracts FP6-001765aceMediaandFP6-027685MESH. v Contents Contributors....................................................... ix ListofAbbreviations ............................................... xiii PartI Introduction 1 IntroductiontoSemanticMultimedia.............................. 3 YiannisKompatsiarisandPaolaHobson PartII MultimediaOntologies,AnalysisandReasoning–Theory 2 MultimediaContentDescriptionUsingSemanticWebLanguages..... 17 Roberto Garc´ıa, Chrisa Tsinaraki, O`scar Celma, and Stavros Christodoulakis 3 Ontology-Based Reasoning Techniques for Multimedia InterpretationandRetrieval ..................................... 55 RalfMo¨llerandBerndNeumann 4 IntroducingContextandReasoninginVisualContentAnalysis:An Ontology-BasedFramework ..................................... 99 Stamatia Dasiopoulou,Carsten Saathoff, PhivosMylonas, Yannis Avrithis,YiannisKompatsiaris,SteffenStaab,andMichaelG.Strinztis 5 AudioContentAnalysis ..........................................123 Juan Jose´ Burred, Martin Haller, Shan Jin, Amjad Samour, andThomasSikora PartIII ApplicationsUsingSemanticWebTechnologies 6 PersonalisedMultimediaSummaries ..............................165 Cathy Dolbear, Paola Hobson, David Vallet, Miriam Ferna´ndez, Iva´nCantadorandPabloCastells vii viii Contents 7 TheRoleofOntologiesfor3DMediaApplications ..................185 MichelaSpagnuoloandBiancaFalcidieno 8 TheApplicationofSemanticWebTechnologiestoMultimediaData FusionwithineScience .......................................... 207 JaneHunter,SuzanneLittle,andRonaldSchroeter Part IV Applications Using Alternative Approaches to Multimedia Ontologies 9 Mind the Gaps – Finding the Appropriate Dimensional RepresentationforSemanticRetrievalofMultimediaAssets......... 229 WilliamI.Grosky,RajeevAgrawal,andFarshadFotouhi 10 FillingtheSemanticGapinVideoRetrieval:AnExploration.........253 AlexanderHauptmann,Rong Yan,Wei-Hao Lin, MichaelChristel andHowardWactlar PartV Conclusion 11 ConclusionsRelatingtoSemanticMultimediaandOntologies ........281 YiannisKompatsiarisandPaolaHobson WebResources.....................................................285 Index .............................................................287 Contributors RajeevAgrawal KetteringUniversity,Flint,MI,USAandWayneStateUniversity,Detroit, MI,USA e-mail:[email protected] YannisAvrithis Image Video and Multimedia Laboratory,Schoolof Electrical and Computer Engineering,NationalTechnicalUniversityofAthens,Athens,Greece e-mail:[email protected] JuanJose´Burred Communication Systems Group, Technische Universita¨t Berlin, Sekr. EN 1, Einsteinufer17,10587Berlin,Germany e-mail:[email protected] Iva´nCantador UniversidadAuto´nomadeMadrid,Madrid,Spain e-mail:[email protected] PabloCastells UniversidadAuto´nomadeMadrid,Madrid,Spain e-mail:[email protected] O`scarCelma MusicTechnologyGroup,UniversitatPompeuFabra,Barcelona,Spain e-mail:[email protected] MichaelChristel SchoolofComputerScience,CarnegieMellonUniversity,Pittsburgh,PA,USA e-mail:[email protected] StavrosChristodoulakis Laboratoryof Distributed Multimedia InformationSystems and Applications (TUC/MUSIC),TechnicalUniversityofCrete,Chania,Crete,Greece e-mail:[email protected] ix x Contributors StamatiaDasiopoulou MultimediaKnowledgeLaboratory,CentreforResearchandTechnologyHellas, InformaticsandTelematicsInstitute,Thermi-Thessaloniki,Greece e-mail:[email protected] CathyDolbear OrdnanceSurveyResearchLabs,Southampton,UK e-mail:[email protected] BiancaFalcidieno IstitutodiMatematicaApplicataeTecnologieInformatiche,ConsiglioNazionale delleRicerche,Genova,Italy e-mail:[email protected] MiriamFerna´ndez UniversidadAuto´nomadeMadrid,Madrid,Spain e-mail:[email protected] FarshadFotouhi WayneStateUniversity,Detroit,MI,USA e-mail:[email protected] RobertoGarc´ıa Human-ComputerInteractionResearchGroup(GRIHO),UniversitatdeLleida, Lleida,Spain e-mail:[email protected] WilliamI.Grosky UniversityofMichigan-Dearborn,Dearborn,MI,USA e-mail:[email protected] MartinHaller Communication Systems Group, Technische Universita¨t Berlin, Sekr. EN 1, Einsteinufer17,10587Berlin,Germany e-mail:[email protected] AlexanderHauptmann SchoolofComputerScience,CarnegieMellonUniversity,Pittsburgh,PA,USA e-mail:[email protected] PaolaHobson MotorolaLabs,Basingstoke,UK JaneHunter School of InformationTechnologyand Electrical Engineering,University of Queensland,Brisbane,Qld.,Australia e-mail:[email protected] Contributors xi ShanJin Communication Systems Group, Technische Universita¨t Berlin, Sekr. EN 1, Einsteinufer17,10587Berlin,Germany e-mail:[email protected] YiannisKompatsiaris MultimediaKnowledgeLaboratory,CentreforResearchandTechnology–Hellas, InformaticsandTelematicsInstitute,Thermi-Thessaloniki,Greece e-mail:[email protected] Wei-HaoLin SchoolofComputerScience,CarnegieMellonUniversity,Pittsburgh,PA,USA e-mail:[email protected] SuzanneLittle CNRISTI,Pisa,Italy e-mail:[email protected] RalfMo¨ller HamburgUniversityofTechnology,Hamburg,Germany e-mail:[email protected] PhivosMylonas Image Video and Multimedia Laboratory,Schoolof Electrical and Computer Engineering,NationalTechnicalUniversityofAthens,Athens,Greece e-mail:[email protected] BerndNeumann UniversityofHamburg,Hamburg,Germany e-mail:[email protected] CarstenSaathoff ISWeb–InformationSystemsandSemanticWeb,UniversityofKoblenz,Koblenz, Germany e-mail:[email protected] AmjadSamour Communication Systems Group, Technische Universita¨t Berlin, Sekr. EN 1, Einsteinufer17,10587Berlin,Germany e-mail:[email protected] RonaldSchroeter School of InformationTechnologyand Electrical Engineering,University of Queensland,Brisbane,Qld.,Australia e-mail:[email protected] ThomasSikora Communication Systems Group, Technische Universita¨t Berlin, Sekr. EN 1, Einsteinufer17,10587Berlin,Germany e-mail:[email protected] xii Contributors MichelaSpagnuolo IstitutodiMatematicaApplicataeTecnologieInformatiche,ConsiglioNazionale delleRicerche,Genova,Italy e-mail:[email protected] SteffenStaab ISWeb–InformationSystemsandSemanticWeb,UniversityofKoblenz,Koblenz, Germany e-mail:[email protected] MichaelG.Strinztis Information Processing Laboratory, Electrical and Computer Engineering Department,AristotleUniversityofThessaloniki,Thessaloniki,Greece ChrisaTsinaraki Laboratoryof Distributed Multimedia InformationSystems and Applications (TUC/MUSIC),TechnicalUniversityofCrete,Chania,Crete,Greece e-mail:[email protected] DavidVallet UniversidadAuto´nomadeMadrid,Madrid,Spain e-mail:[email protected] HowardWactlar SchoolofComputerScience,CarnegieMellonUniversity,Pittsburgh,PA,USA e-mail:[email protected] RongYan IntelligentInformationManagementDepartment,IBMTJWatsonResearchCenter, Hawthorne,NY,USA e-mail:[email protected]