Efficient and affordable software for Macintosh - Maker of MaxBulk Mailer, eMail extractor, eMail Checker, e-Mail Bounce Handler

Home

Products

Downloads

News

Store

Support

Forums

Forums


 FAQFAQ   SearchSearch   MemberlistMemberlist   UsergroupsUsergroups   RegisterRegister 
 ProfileProfile   Log in to check your private messagesLog in to check your private messages   Log inLog in 
Downloading dynamic .asp site...

 
Post new topic   Reply to topic    Maxprog Forum Forum Index -> Web Dumper
Author Message
wl



Joined: 21 Jun 2006
Posts: 6

PostPosted: Wed Jun 21, 2006 1:26 am    Post subject: Downloading dynamic .asp site... Reply with quote

I'm downloading a dynamic .asp site where product pages all point to the same product_detail.asp but new database data is called from by variables in the URL.

That is product_detail.asp?idprod=11 or product_detail.asp?idprod=34

It does not seem to be creating separate pages for each of these items...it simply keeps overwriting the product_detail.asp?idprod=XXX with whatever is the last page fetched.

Is there some setting I must change?

Site http://www.repcoinc.com
Back to top
stanbusk
Site Admin


Joined: 28 Dec 2005
Posts: 4439

PostPosted: Wed Jun 21, 2006 4:14 pm    Post subject: Reply with quote

Do you have a sample URL?
Back to top
wl



Joined: 21 Jun 2006
Posts: 6

PostPosted: Wed Jun 21, 2006 4:27 pm    Post subject: URL already in my first post Reply with quote

http://www.repcoinc.com

This is the site I'm trying to download...you'll see under Carbon Brushes and under Electrical Contacts most of the data is dynamicly pulled from databases.
Back to top
stanbusk
Site Admin


Joined: 28 Dec 2005
Posts: 4439

PostPosted: Wed Jun 21, 2006 8:20 pm    Post subject: Reply with quote

Do you know a page containing 'product_detail.asp?idprod=34 ' like links so I can try directly?
Back to top
wl



Joined: 21 Jun 2006
Posts: 6

PostPosted: Wed Jun 21, 2006 8:43 pm    Post subject: Sample pages Reply with quote

Carbon Brushes:
http://www.repcoinc.com/carbon_brushes_fld/carbon_brushes_list.asp?fid=chr&mfg=32

http://www.repcoinc.com/carbon_brushes_fld/carbon_brushes_list.asp?fid=chr&mfg=1


Electrical Contacts:
http://www.repcoinc.com/e-contacts_fld/e-contacts-OEMseries.asp?mf=41

http://www.repcoinc.com/e-contacts_fld/e-contacts-OEMseries.asp?mf=42

Allen-Bradley (and others) then link to their respective series:
http://www.repcoinc.com/e-contacts_fld/e-contacts-series.asp?mf=42&mfs=2

Series then provide individual product pages:
http://www.repcoinc.com/e-contacts_fld/e-contacts-detail.asp?mf=42&p_id=38
Back to top
wl



Joined: 21 Jun 2006
Posts: 6

PostPosted: Wed Jun 21, 2006 8:49 pm    Post subject: My original example was not exact coding from site... Reply with quote

Just want to point out that in my original post the product_detail.asp?idprod=XX was not actual code in the site...I was merely "paraphrasing" the code for brevity. The post above this does contain the actual code for pages in the site.

What I'm looking for Web Dumper to:

1) Find the electrical contacts page (and the other sections too)

2) Follow each OEM NAME link to the Series List Page

3) Follow each series link to each individual series listing

4) Follow each product link to the respective product detail page


I do NOT expect it to:


1) Follow or understand the javascript menus - but it shouldn't have to...it can follow all the regular links to drill down to each and every product detail page.
Back to top
wl



Joined: 21 Jun 2006
Posts: 6

PostPosted: Wed Jun 28, 2006 1:28 pm    Post subject: Any progress or update on this issue? Reply with quote

Just wondering if anybody has any input on this problem or if I should look for another application to accomplish my needs?
Back to top
wl



Joined: 21 Jun 2006
Posts: 6

PostPosted: Wed Jun 28, 2006 3:58 pm    Post subject: Found another program that works Reply with quote

Just in case anyone else encounters an issue similar to mine. Web Dumper does not seem to be able to accomplisht this task.

I found another program Web Whacker that worked flawlessly. Hopefully in the future Web Dumper will add this ability as I'd prefer to use a Mac based program. But until it does...I'm stuck
Back to top
Display posts from previous:   
Post new topic   Reply to topic    Maxprog Forum Forum Index -> Web Dumper All times are GMT
Page 1 of 1

 


Powered by phpBB © 2001, 2005 phpBB Group
captcha mod by phpbb-security.com

Home

Products

Downloads

News

Store

Support

Forums


Maxprog ® - MAX Programming, LLC - © 2001-2006 - All Rights reserved
Company Info | Site Map | Legal Notice | Privacy Policy | Jobs