User Interface Softbots
| dc.contributor.advisor | Dr. Munindar Singh, Committee Member | en_US |
| dc.contributor.advisor | Dr. Michael Young, Committee Member | en_US |
| dc.contributor.advisor | Dr. Robert St. Amant, Committee Chair | en_US |
| dc.contributor.author | Dudani, Ajay | en_US |
| dc.date.accessioned | 2010-04-02T18:10:42Z | |
| dc.date.available | 2010-04-02T18:10:42Z | |
| dc.date.issued | 2003-12-11 | en_US |
| dc.degree.discipline | Computer Science | en_US |
| dc.degree.level | thesis | en_US |
| dc.degree.name | MS | en_US |
| dc.description.abstract | A user interface softbot is a software agent that controls an interactive system through its graphical user interface, relying on visual information of the system rather than an application programming interfaces or access to source code. We have developed a prototype system that facilitates the use and extension of interface softbots, reforming the programming process and making it easier for new developers. We present the JSegMan substrate that facilitates the representation and identification of the conventional graphical user interface. The JSegMan substrate consists of sensors, effectors and framework for an agent that can control the user interface environment. Using image processing the sensor builds a representation of the desktop's visual interface. The effector module generates mouse and keyboard gestures to control the desktop environment. The sensor and effector modules work as eyes and hands of a controller application that can be tailored for a given application domain. We also present three applications - MSN Chatbots, the classical Blocks World problem solver and a GUI testing tool that use the JSegMan substrate and demonstrates applicability of JSegMan in use with off-the shelf applications, PDDL based planners and in testing environment respectively. | en_US |
| dc.identifier.other | etd-12112003-115434 | en_US |
| dc.identifier.uri | http://www.lib.ncsu.edu/resolver/1840.16/2132 | |
| dc.rights | I hereby certify that, if appropriate, I have obtained and attached hereto a written permission statement from the owner(s) of each third party copyrighted matter to be included in my thesis, dissertation, or project report, allowing distribution as specified below. I certify that the version I submitted is the same as that approved by my advisory committee. I hereby grant to NC State University or its agents the non-exclusive license to archive and make accessible, under the conditions specified below, my thesis, dissertation, or project report in whole or in part in all forms of media, now or hereafter known. I retain all other ownership rights to the copyright of the thesis, dissertation or project report. I also retain the right to use in future works (such as articles or books) all or part of this thesis, dissertation, or project report. | en_US |
| dc.subject | Planning | en_US |
| dc.subject | Agents | en_US |
| dc.subject | Interface softbots | en_US |
| dc.title | User Interface Softbots | en_US |
Files
Original bundle
1 - 1 of 1
