Kindest, I was wondering about a few points I havn't seen any references to. Are there any implementations in Zope that can verify the validity of an url? That is; 1) A link database is generated .. and should be maintained. 2) A process should be run at least once a week to check the validity of links in the database. 3) If the link is not "valid" .. it sets a tag in the db which says it's untrusted .. which again could show that in the link listed on the web through Zope. 4) .. and if it's untrusted for N runs .. it is removed. .. have anyone looked into that? .. and anyone made any conclusions as to how one can solve that? I am not that familiar with Python .. but I might be interested in generating such an engine.. based on Zope / mySql of some sorts. .. Perl support would really make me happy right now! Have a real nice day. Kindest, Jørgen Skogstad
Hi! I am working on such project for a few years. From time to time I make an announcement in comp.lang.python, subject "Bookmarks database and Internet robot". This is a copy of my latest announce: http://www.deja.com/=dnc/getdoc.xp?AN=626677041 It my hobby project, in pure Python. Wanna cooperate on this? On Thu, 1 Jun 2000, [Windows-1252] JЬrgen Skogstad wrote:
I was wondering about a few points I havn't seen any references to. Are there any implementations in Zope that can verify the validity of an url? That is;
1) A link database is generated .. and should be maintained. 2) A process should be run at least once a week to check the validity of links in the database. 3) If the link is not "valid" .. it sets a tag in the db which says it's untrusted .. which again could show that in the link listed on the web through Zope. 4) .. and if it's untrusted for N runs .. it is removed.
.. have anyone looked into that? .. and anyone made any conclusions as to how one can solve that?
Oleg. (All opinions are mine and not of my employer) ---- Oleg Broytmann Foundation for Effective Policies phd@phd.russ.ru Programmers don't die, they just GOSUB without RETURN.
Hi there.. Sure! I just did a quick read through of the url you posted and it looks to me that you've started with what I want. I am very interested in getting this to work within the Zope framework as well.. with Sql support etc. as I am doing a project that would require "robotic" features! ;) Don't we just hate manual labour. ;) .. I'll take a look at what you've done .. and get back to you later this weekend. I'm in the process of moving and I have a @34@? of packing to do. Ttyl.. .. and have a real nice day! Kindest, Jorgen ----- Opprinnelig melding ----- Fra: Oleg Broytmann <phd@phd.russ.ru> Til: Jшrgen Skogstad <jorgen.skogstad@c2i.net> Kopi: <zope@zope.org> Sendt: 1. juni 2000 12:39 Emne: Re: [Zope] Q: Link status/checking
Hi!
I am working on such project for a few years. From time to time I make an announcement in comp.lang.python, subject "Bookmarks database and Internet robot". This is a copy of my latest announce: http://www.deja.com/=dnc/getdoc.xp?AN=626677041
It my hobby project, in pure Python. Wanna cooperate on this?
On Thu, 1 Jun 2000, [Windows-1252] JЬrgen Skogstad wrote:
I was wondering about a few points I havn't seen any references to. Are there any implementations in Zope that can verify the validity of an url? That is;
1) A link database is generated .. and should be maintained. 2) A process should be run at least once a week to check the validity of links in the database. 3) If the link is not "valid" .. it sets a tag in the db which says it's untrusted .. which again could show that in the link listed on the web through Zope. 4) .. and if it's untrusted for N runs .. it is removed.
.. have anyone looked into that? .. and anyone made any conclusions as to how one can solve that?
Oleg. (All opinions are mine and not of my employer) ---- Oleg Broytmann Foundation for Effective Policies phd@phd.russ.ru Programmers don't die, they just GOSUB without RETURN.
Hi! On Sat, 3 Jun 2000, Jшrgen Skogstad wrote:
Sure! I just did a quick read through of the url you posted and it looks to me that you've started with what I want. I am very interested in getting this to work within the Zope framework as well.. with Sql support etc. as I am doing a project that would require "robotic" features! ;) Don't we just hate manual labour. ;)
Well, the weakiest point in my programs is that these programs operate on the whole tree at once. This isn't a problem for my small database of URLs - there are about 3000 URLs in my bookmarks; but certainly will bring problems for those who would like to have a bigger DB. What I feel is that Zope is not by itself the way to go. It is hard to store the entire URLs tree in Zope and operate via XML-RPC or whatever. I thing much better approach will be to store the tree in separate database (SQL, e.g.) and connect both the robot and Zope to the DB. While we are on subjject - I think about version 4 of the project. I want to define clear APIs for database plugins (including the possibility to operate on a part of DB, down to one URL at at time :) and robots; and remove writers plugins entirely - writers are just storage managers, actually. It is interesting, whow in time Andrew Kuchling announced Oedipus. His announcement came few days after I realized that I need API to operate on a part of DB and started to think about version 4. http://oedipus.sourceforge.net/ We need a DB plugin to connect my robot to Oedipus; and Zope Product... Oleg. (All opinions are mine and not of my employer) ---- Oleg Broytmann Foundation for Effective Policies phd@phd.russ.ru Programmers don't die, they just GOSUB without RETURN.
I see the ownership tab in the new Zope. Where can I find some more info on this. Currently my setup says Zope has no owner. Apparently it needs one.... ----- Original Message ----- From: "Oleg Broytmann" <phd@phd.russ.ru> To: "Jшrgen Skogstad" <jorgen.skogstad@c2i.net> Cc: <zope@zope.org> Sent: Monday, June 05, 2000 4:37 AM Subject: [Zope] Re: SV: [Zope] Q: Link status/checking Hi! On Sat, 3 Jun 2000, Jшrgen Skogstad wrote:
Sure! I just did a quick read through of the url you posted and it looks to me that you've started with what I want. I am very interested in getting this to work within the Zope framework as well.. with Sql support etc. as I am doing a project that would require "robotic" features! ;) Don't we just hate manual labour. ;)
Well, the weakiest point in my programs is that these programs operate on the whole tree at once. This isn't a problem for my small database of URLs - there are about 3000 URLs in my bookmarks; but certainly will bring problems for those who would like to have a bigger DB. What I feel is that Zope is not by itself the way to go. It is hard to store the entire URLs tree in Zope and operate via XML-RPC or whatever. I thing much better approach will be to store the tree in separate database (SQL, e.g.) and connect both the robot and Zope to the DB. While we are on subjject - I think about version 4 of the project. I want to define clear APIs for database plugins (including the possibility to operate on a part of DB, down to one URL at at time :) and robots; and remove writers plugins entirely - writers are just storage managers, actually. It is interesting, whow in time Andrew Kuchling announced Oedipus. His announcement came few days after I realized that I need API to operate on a part of DB and started to think about version 4. http://oedipus.sourceforge.net/ We need a DB plugin to connect my robot to Oedipus; and Zope Product... Oleg. (All opinions are mine and not of my employer) ---- Oleg Broytmann Foundation for Effective Policies phd@phd.russ.ru Programmers don't die, they just GOSUB without RETURN. _______________________________________________ Zope maillist - Zope@zope.org http://lists.zope.org/mailman/listinfo/zope ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope-dev )
participants (4)
-
J. Michael Mc Kay -
Jørgen Skogstad -
Jшrgen Skogstad
-
Oleg Broytmann