You are here:
- Home
- Internet/Online
- Internet Technologies
- Programming Web Crawling Bots, Intelligent Agents
Programming Web Crawling Bots, Intelligent Agents/Questions Answered by Expert Marcus P. Zillman, M.S., A.M.H.A.
| Subject | Date Asked |
| How to query the SQL | 5/2/2011 |
| Q: I wish to seek your advice or opinion regarding one of my question, we use php and mySQL for ... A: ... Thanks for your question .... As my expertise is in a different area I would recommend the ... | |
| Ghosting, Craigslist | 11/22/2010 |
| Q: Zillman, Thank you for your interest in answering my email. I'm a regular poster in Craigslist for ... A: ... Thanks for the eMail and question ..... I am not familiar with the latest update for Craiglist ... | |
| Any tool to receive full ads from Craiglist on email? (not just alerts!)? | 7/30/2010 |
| Q: Recently I found dozens of different sites and programs that help you to search for the ads you need ... A: .... Thanks for the eMail and question ..... I do not know of any tools that will perform the ... | |
| Intelligent Agents basics | 3/15/2010 |
| Q: Some basic questions 1.- What are the main attributes should an intelligent agent have? 2.- What ... A: ... Thanks for the eMail and question ..... 1) Intelligent agents should have the capability of ... | |
| at start up of computer | 2/21/2010 |
| Q: helo marcus I have had a HP PC (Vista OS) for 2 years now and have very recently noticed an ... A: .. Thanks for the eMail and question ..... First I am not an expert in this area so I can only ... | |
| Bots / Intelligent Agents Program | 1/28/2010 |
| Q: Is it possible to develop a intelligent crawler / bot program for the following task: Direct the ... A: .... Thanks for the eMail and question ..... Yes I believe that you should be able to accomplish ... | |
| Capturing an online database | 11/29/2009 |
| Q: Marcus, There is an online directory that contains approximately 10,000 company listings. Each ... A: ... Thanks for the eMail and request .... If you email me at tne below address I will request ... | |
| how to make search suggestions more efficent | 11/17/2009 |
| Q: I'd want to if you've anything in mind about making the search suggestions more efficient and more ... A: ... Thanks for the eMail and question .... Search suggestions or search querys? Search ... | |
| is developing crawling bots possible with SQL | 11/2/2009 |
| Q: I want to develop a site where I'm gonna offer an exclusive search engine for specific work, not ... A: ... Thanks for the eMail and question .... As I am not sure of your IP resources I would recommend ... | |
| Batch File | 10/5/2009 |
| Q: I am trying to write a batch file or vb script. I need it to ping a list of devices from a file and ... A: ... Thanks for the eMail and question .... My expertise is not in vb script or batch files but I ... | |
| Internet Marketing Ads | 10/2/2009 |
| Q: Is there any way to sign up with an affiliate marketing site such as azoogle ads, roi rocket, or ... A: .. Thanks for the email and question .... To the best of my knowledge I do not know of a way to ... | |
| Automated Refresh | 10/2/2009 |
| Q: I regularly use a web site to search for per diem jobs. I have to repeatedly use a mouse to click on ... A: ... Thanks for the eMail and question .... Normally a site will push out a refreshed page like the ... | |
| Apps. | 9/14/2009 |
| Q: I'm designing a Website which will have a link that can be downloaded onto a computer in order to ... A: .. Thanks for the eMail and question ..... I would recommend a number of things that you can do: ... | |
| Identifying Duplicate Events on Websites | 8/21/2009 |
| Q: I am working on an open source bot that would spider websites to find events, notably conferences. ... A: ... Thanks for the email and question .... Yes it surely seems to be a very good road block. The ... | |
| Websense Web Filtering | 7/9/2009 |
| Q: Good morning Marcus, I was wondering if you know anything about Websense. We just upgraded to Web ... A: ... Thanks for the email and question ...... I am not an expert on the Websense program so I ... | |
| form filling | 4/14/2009 |
| Q: Mr. Zillman: If this is not your area, please forgive the question, but perhaps you can direct me ... A: Rodney ... Thanks for the eMail and question .... This is somewhat out of my expertise but I would ... | |
| Programming Email Search | 3/24/2009 |
| Q: I work on projects where I need to contact betwee 100 to 400 web sites (I recieve only their domain ... A: Moshe ... Thanks for the eMail and question .... There is no easy way that will guarantee 100% ... | |
| knowledge | 3/20/2009 |
| Q: what crawler related to internet A: .. Thanks for the eMail and question .... There are a number of crawlers related to the Internet. ... | |
| Robots | 2/18/2009 |
| Q: I am an enrichment student. I would like to know what will happen to robots after a long period of ... A: ... Thanks for the email and question ... My expertise is in Bots and Intelligent Agents that ... | |
| connect to internet | 2/9/2009 |
| Q: ! i wish to have a Internet access, but i don't have any source only unto my nokia mobile, ive heard ... A: ... Thanks for the eMail and question ..... What you are looking for is outside of my expertise ... | |
| general question | 2/7/2009 |
| Q: where would i look if i wanted to develop a website like mysimon.com. I am look to collaborate ... A: ... Thnaks for the question and request .... As there are many ways to perform the task you ... | |
| what is? | 12/20/2008 |
| Q: what is and how do I make a web crawler A: .. Thanks for the eMail and question ..... A web crawler is a bot (robot) algorithmic script that ... | |
| Getting started | 12/10/2008 |
| Q: I have done countless google searches for AI and/or chat bots but I cannot find what I'm looking ... A: .. I would ry the following: Agent Construction Tools http://www.agentbuilder.com/ AgentSheets - ... | |
| Getting started | 12/10/2008 |
| Q: I have done countless google searches for AI and/or chat bots but I cannot find what I'm looking ... A: .. Thanks for the eMail and question .... I would recommend you looking at the following sites: ... | |
| SEARCH ENGINES | 11/14/2008 |
| Q: we know most of them use google,yahoo etc., for searches.but i come across a lot of search engines ... A: ... Yes you are correct that most students are using the major search engines unless they are ... | |
| SEARCH ENGINES | 11/14/2008 |
| Q: we know most of them use google,yahoo etc., for searches.but i come across a lot of search engines ... A: ... Thanks for the eMail and question ..... There are a number of niched search engines that have ... | |
| Bot | 10/1/2008 |
| Q: i would like to discover a new search engine like google.but i have no basics about search ... A: ... Thanks for the eMail and question ..... I would recommend that you read the following 15 page ... | |
| Automatized Download Script | 9/10/2008 |
| Q: here is my problem: I am working on the database which is available on the untreaty.un.org this is ... A: ... Thanks for the eMail and question .... There are a number of ways and programs to accomplish ... | |
| Scripts, Bots, and Programs that use both | 7/22/2008 |
| Q: I'm hoping you can answer a few questions for me. Please correct me if my perception of this is ... A: ... Thanks for the eMail and questions ..... Scripts are different that bots in that they are ... | |
| Question about Ebook | 7/7/2008 |
| Q: I have spend hours and hours trying to find out how I can add an ebook that I have saved in Adobe ... A: .. Thanks for the eMal and question .... This is some what out of my expertise and I can only give ... | |
| computer wont connect to the internet..help | 7/6/2008 |
| Q: i coulnt find the category i needed.. this was the closest one, im sorry... my gateway notebook ... A: ... Thanks for the eMail and question .... The area of your concern is out of my expertise area ... | |
| What does 406 mean? | 5/21/2008 |
| Q: I tried to look up what 406 means but I still don't get it. If I enter a webpage and it appears as a ... A: .. Yes you are correct ... WW3 defines Error 406: The resource identified by the request is only ... | |
| web crawler language | 4/12/2008 |
| Q: Which programming language you will rate best for programming a web crawler and search engine. ... A: .. Thanks for the eMail and question .... I would say that C++ does an excellent job with RUBY ... | |
| about the intelligent system... | 2/15/2008 |
| Q: may i know all the types of intelligent system ?? note that it's intelligent system but not ... A: ... Sorry that my answers did not fulfill your request. I must have not interpeted your question ... | |
| Bots | 10/23/2007 |
| Q: I hope you can help me. I am looking for some smart AI software components that would read XML, and ... A: ... Thanks for the eMail and question ... AI software that will read XML .... hmmm ..... I cannot ... | |
| nlp | 9/23/2007 |
| Q: which book u will suggest me to follow for learning natural language processing programming in lisp. ... A: Helo Robin ... Thanks for the eMail and question ... I would recommend one of the following: ... | |
| working on project | 9/17/2007 |
| Q: well i wish to submit a project on this topic. so plz provide me the max information abt this.. A: ... Thanks for the eMail and request .... I would highly recommend that you visit the following ... | |
| information technology architecture | 9/15/2007 |
| Q: I was wondering if you can assist me with a question that i'm curious about. Do you know of any new ... A: .. Thanks for the email and question .... I nwould recommend that you visit the following ... | |
| Newslinks | 9/14/2007 |
| Q: This is a news feeds question, but with your technology savvy, you might have an answer. I need a ... A: .. Thanks for the eMail and question .... I would recommend that you visit the foillowing site and ... | |
| Web Automation | 9/5/2007 |
| Q: I am working on a web automation project, a script which can enter a web server on a LAN, fill in ... A: .. Thanks for the eMail and question .... I would recommend that you visit the following resource: ... | |
| reagaing extraction of data from Flash object files | 7/18/2007 |
| Q: iam a web crawling engineer with trueadvantage Organization. we had found problem regarding crawling ... A: .. Thanks for the eMail and question ... Obtaining information from flash objects as well as ... | |
| webspider | 6/13/2007 |
| Q: i work for a company whose knowledgebase is available on the intranet. occasionally, i need to ... A: .. Thanks for your email and question. I would recommend that you visit the following resource that ... | |
| web automation | 5/17/2007 |
| Q: hey Marcus, since ur expert category please tell me if i want perform web automation like autologin ... A: ... Thanks for the eMail and question. As a expert in bots and intelligent agents this is somewhat ... | |
| Artificial Intelligence | 4/21/2007 |
| Q: Any game using AI in java language. plz send it me soon A: ... I do not know of any games using AI language using JAVA. I would look through the following: ... | |
| seach results | 4/17/2007 |
| Q: I have a couple of problems with two websites that we have designed. As we are a non profit ... A: ... Thanks for the email and question .... My expertise is in bots, blogs and news aggregators ... | |
| Old web site | 4/3/2007 |
| Q: I need to access some info from a web site that is not available anymore - can you tell me how I ... A: You may want to try some of these resources but they only archive selected sites bit worth a try: ... | |
| Old web site | 4/3/2007 |
| Q: I need to access some info from a web site that is not available anymore - can you tell me how I ... A: .... Thanks for the eMail and question ..... I would visit the following resource: The Way Back ... | |
| tools | 3/28/2007 |
| Q: My name is Claude Stéphane Laroche, i am planning to start an import/export business but my ... A: .. Thanks for the eMail and question. I would recommend that you visit the following resource that ... | |
| Blog Crawling Bot | 3/15/2007 |
| Q: I have no experience in making a bot, and I wish to make a simple bot that would crawl rss feeds and ... A: .... Thanks for the eMail and question .... A bot to discover RSS feeds ..... interesting .... I ... | |
| mkh | 1/12/2007 |
| Q: Is there some website or computer robot, which can send my opinions to all Internet forums or the ... A: .. Thanks for the email and question .... There is not a standard bot that performs the functions ... | |
| Freeware for erasing web sites visited | 12/24/2006 |
| Q: My husband and I surf extensively. Is there any generic freeware for the home user which one can ... A: .. Thanks for the email and question .... I would recommend that you visit the following site ... | |
| visual search engine | 12/13/2006 |
| Q: Is there a search engine that can find photos of someone based on an image I submit? A: .. Thanks for the eMail and question .... I wish there was a serach protocol that would search for ... | |
| ADDRESS BAR | 11/11/2006 |
| Q: Can you tell me who I could talk to (that runs the internet) in order to get the programming changed ... A: .. Thanks for the email and question .... The domain naming authority ICANN would be the one that ... | |
| Robots Project | 10/1/2006 |
| Q: Can you still answer my questions on virtual bots please? We can do any "bots" and this is due ... A: Emily ... Here are the answered questions ... 1) How have robots changed society? Yes bots have ... | |
| Robots Project | 10/1/2006 |
| Q: My name is Emily and I’m in the eighth grade. We are doing a technology project for science and my ... A: .. Thanks for the eMail and question about robots .... The robots that I am an expert in are ... | |
| realtime | 9/16/2006 |
| Q: When will it be (2015 or 2035, etc.) that a person can just talk to his computer, or an annimated ... A: ... Thanks for the question ..... I would say what you desire in AI will happen in the next 20 ... | |
| pop ups | 7/17/2006 |
| Q: how do i develop pop ups for my website A: ... This is out of my expertise but I would recommend one of the following sites where you could ... | |
| size of a web page | 7/9/2006 |
| Q: i need to know what is the average size of a web page... for instance if i click on ... A: .. Thanks for the email and question .... Your question on the size of the average size of a web ... | |
| Automatic Answer Software | 6/22/2006 |
| Q: Sir, I need a software that recieves the question from the user as text input and that particular ... A: ... Yes you can download various available software but I would recommend the freely available ... | |
| Intelligent shopping agent | 10/24/2005 |
| Q: Zillman We are a group of university students CS department. We have chosen to make an <AI ... A: ... I would recommend to you the following resources: Shopping Bots http://www.ShoppingBots.info/ ... | |
| using agents in search techniques | 10/19/2005 |
| Q: plz give me a brief discription of agents as i m feeling some trouble in getting the points about ... A: ... Thanks for the email and question .... Agents and bots are algorithmic scipts ( mathematical ... | |
| AI & Bots | 5/17/2005 |
| Q: Would you kindly refer me to educational or gov sites or even book titles on the internet that ... A: ... Thanks for the eMail and question. I would recommend the following resources: Artificial ... | |
| Crawling bots | 4/16/2005 |
| Q: can u pls make me understand what is crawling bots Regards shiv A: ... Thanks for the eMail and question ..... Crawling bots are technically speaking algorithmic ... | |
| What is Crawling Bots | 4/14/2005 |
| Q: My self Imran r bhadelia a sr s/w developer on Saltriver Infosystems. Can you put light on what ... A: .. Thanks for the email and question .... I would recommend that you visit the following sources ... | |
| Fixed-priority item selection strategy | 3/20/2005 |
| Q: I'm looking for a simple algorithm for selecting items with fixed priority. I.e. if I have a set of ... A: .. Thanks for the eMail and question .... Hmmm..... I would recommend that you visit the following ... | |
| Web Crawler? | 2/17/2005 |
| Q: I wonder if you can help? Im attempting to build a smart web scraping tool as a project. My tool ... A: ... Thanks for the eMail and question ..... I would recommend that you visit the following site: ... | |
| Robotice Science Fair Project | 1/1/2005 |
| Q: I am in the 6th grade and would like to do a science fair project on Robotics. Do you have any ... A: ... Thnaks for the email and your question..... I would recommend the following resources for you: ... | |
| Where to start? | 12/16/2004 |
| Q: I would like To learn programing Intelligent Agents. I would be pleased If you told me where To ... A: .... Thanks for the email and question .... I would recommend the following site. It is a site ... | |
| government agents | 11/22/2004 |
| Q: I am a fourth grade student at Green's Farms School and I am doing a project on the CIA and the FBI. ... A: ... Thank you for your eMail and question..... I am the creator and developer of "virtual" ... | |
| Engineering versus Dentistry | 10/13/2004 |
| Q: I am a computer science engineering student at UTD looking to go into intelligent systems or ... A: .. Thank you for the eMail and question. I would recommend the following resources to reinforce ... | |
| Summary Writer | 9/10/2004 |
| Q: Is there some software that when given a piece of text could write its summary? If there is plz give ... A: ... Thanks fot the email and question ... I would recommend the Summarizer by Copernic at: ... | |
| chat bot | 8/12/2004 |
| Q: I am looking for a bot that can be placed in a Yahoo chat room to greet people coming in. I would ... A: ... Thanks for the eMail and question. I would recommend the following: ... | |
| IE macro that saves a website periodically | 7/20/2004 |
| Q: I need to build a macro that saves a certain website with online data, each predefined time, into a ... A: .. Thanks for the eMail and question. My specialty is bots and intelligent agents and not macros ... | |
| How to... | 6/22/2004 |
| Q: I've been wondering how to make a program simulate some intelligence. For example, Poker - how ... A: ... Thanks for the eMail and question ..... My expertise is in the area of bots and intelligent ... | |
| Guard Agents? | 6/5/2004 |
| Q: I would like to either find an existing bot/agent or create one which monitors users on my website ... A: ... Thanks for your eMail and GuardBots have been around for some time to guard IRC protocols. ... | |
| Data Mining | 5/25/2004 |
| Q: Zillman, M.S., A.M.H.A. I Have A question About "Data Mining". I Want To Know What Is Data Mining ? ... A: ... Thanks for the eMail and Question .... There are a number of resources for data mining .... ... | |
| Agent Languages | 5/4/2004 |
| Q: Marcus, background: I am currently researching the topic of agent technology as part of my ... A: .. Thanks for the email and question .... I would recommend that you visit my Subject Tracer ... | |
| Microsoft Agent | 3/19/2004 |
| Q: I am wanting to run a stand alone app from Macromedia Flash's actionscript, it needs to run ... A: .. Thanks for the eMail and question .... I do not do Microsoft Agent but would recommend the ... | |
| What platform must I take? | 1/20/2004 |
| Q: I must develop a system who goes around the web taking information from there, making any operation ... A: ... Thanks for the eMail and question.... I would recommend that you visit my subject tracer ... | |
| web crawler | 4/30/2003 |
| Q: If I want to have a bot crawling the web and bring back clean text, do I have to develop that myself ... A: ... Thanks for the eMail and question ..... There are many many "good" search bots available and ... | |
| create kind of database on the net | 11/3/2002 |
| Q: I would like to make a website where people can add there information by topics. For example the ... A: ... Thanks for the email and question.... There are a number of websites on the Internet that ... | |
| Live Video and Audio broadcasting bandwidth question | 4/6/2002 |
| Q: I don't know if this question fall into your category but since I haven't found a defined category ... A: ... Thanks for the eMail and question.... Your question is really out of my specific expertise of ... | |
| Getting Started | 3/13/2002 |
| Q: I am starting a website soon which will among other things, periodically crawl a list of user ... A: ... Thanks for the eMail and question.... There are a number of resources out there to help you ... | |
| How do I program a web crawling? | 2/5/2002 |
| Q: Where can I learn to program a web crawling bot? A: .. Thanks for the email and question on programming crawlers.... There are a number of resources ... | |
| Web Crawling Bots | 8/23/2001 |
| Q: Marcus, I am just getting into programming and I just found this site and this topic was just really ... A: ... Thanks for the eMail and information request... I would recommend the following resource that ... | |
| intelligent agents on the internet | 8/12/2001 |
| Q: Who is credited with creating the first bots used to search the internet? A: .. Thanks for the eMail....Great question.... SearchBot...hmmm.... IRC bots did some searching ... | |
| Info agent | 7/14/2001 |
| Q: I'm an IT student. Assigned to research on information agents. Can I know what it is? And where can ... A: .. Thanks for the eMail and question about "information agents". Information Agents are subsets of ... | |
| web crawling | 5/14/2001 |
| Q: I would like to know how to implement web crawling bots. I'm new to this, would be glad if you could ... A: .. Thanks for the email. Sorry that I have not responded earlier but I just received it today ... | |
| artificial agents | 4/21/2001 |
| Q: can you mention me a few recents books on this? sincerely yours, A: .. Thanks for the eMail and question... First I would recommend that you visit the following URL ... | |
| making an intelligent crawler | 2/21/2001 |
| Q: I have already written a crawler. I just want to make it more intelligent. How do I do that? I have ... A: .. Thanks for the eMail... The idea of site related info into schema type definition is fine. ... | |
| Spy Ware | 1/2/2001 |
| Q: Mr. Zillman, Ad-aware ran a scan on my Pen III Gateway 450 running Win 98. It came up with; web3000 ... A: .. Thanks for the email and request... These are little web bugs that the advertising folksd ... | |
| crawler | 12/15/2000 |
| Q: Marcus, I have a few questions, Is there a reliable open source crawler out there? I have download ... A: .. There are a number of open source search bots....below are the URLs for some of them: ... | |
| Robots text file in my internet directory. | 12/4/2000 |
| Q: Mr. Zillman, Can you please explain to me what the following text file is doing ( what its purpose ... A: .. Thanks for the eMail.... There are a number areas and concerns when it comes to the robot.txt ... | |
| MS Agents | 8/27/2000 |
| Q: I have seen the MS Agents (over the web) recently and I am very impressed with it. Is there an easy ... A: .. Thanks for the eMail... I would recommend that you go to one of the following URLs: ... | |
| Where can a find a crawler? | 5/10/2000 |
| Q: Are there crawlers already built that I can use, where I just have to set the parameters. If not ... A: .... Thanks for the eMail..... There are a number of resources out there for crawlers and I will ... | |
| web crawling bots | 3/26/2000 |
| Q: i`d like to know how do you setup a web crawling bot to search for webpages. i guess this is the ... A: .. To create a web crawling bot you need to create/edit/obtain an algorithmic code/script that has ... | |
Programming Web Crawling Bots, Intelligent Agents
Answers by Expert:
Marcus P. Zillman, M.S., A.M.H.A.
Top Expert on this page
Expertise
Information related bots and intelligent agents on the Internet.
©2012 About.com, a part of The New York Times Company. All rights reserved.