User Interface Softbots

Show simple item record

dc.contributor.advisor Dr. Munindar Singh, Committee Member en_US
dc.contributor.advisor Dr. Michael Young, Committee Member en_US
dc.contributor.advisor Dr. Robert St. Amant, Committee Chair en_US Dudani, Ajay en_US 2010-04-02T18:10:42Z 2010-04-02T18:10:42Z 2003-12-11 en_US
dc.identifier.other etd-12112003-115434 en_US
dc.description.abstract A user interface softbot is a software agent that controls an interactive system through its graphical user interface, relying on visual information of the system rather than an application programming interfaces or access to source code. We have developed a prototype system that facilitates the use and extension of interface softbots, reforming the programming process and making it easier for new developers. We present the JSegMan substrate that facilitates the representation and identification of the conventional graphical user interface. The JSegMan substrate consists of sensors, effectors and framework for an agent that can control the user interface environment. Using image processing the sensor builds a representation of the desktop's visual interface. The effector module generates mouse and keyboard gestures to control the desktop environment. The sensor and effector modules work as eyes and hands of a controller application that can be tailored for a given application domain. We also present three applications - MSN Chatbots, the classical Blocks World problem solver and a GUI testing tool that use the JSegMan substrate and demonstrates applicability of JSegMan in use with off-the shelf applications, PDDL based planners and in testing environment respectively. en_US
dc.rights I hereby certify that, if appropriate, I have obtained and attached hereto a written permission statement from the owner(s) of each third party copyrighted matter to be included in my thesis, dissertation, or project report, allowing distribution as specified below. I certify that the version I submitted is the same as that approved by my advisory committee. I hereby grant to NC State University or its agents the non-exclusive license to archive and make accessible, under the conditions specified below, my thesis, dissertation, or project report in whole or in part in all forms of media, now or hereafter known. I retain all other ownership rights to the copyright of the thesis, dissertation or project report. I also retain the right to use in future works (such as articles or books) all or part of this thesis, dissertation, or project report. en_US
dc.subject Planning en_US
dc.subject Agents en_US
dc.subject Interface softbots en_US
dc.title User Interface Softbots en_US MS en_US thesis en_US Computer Science en_US

Files in this item

Files Size Format View
etd.pdf 1.002Mb PDF View/Open

This item appears in the following Collection(s)

Show simple item record