1. Halo Guest, pastikan Anda selalu menaati peraturan forum sebelum mengirimkan post atau thread baru.

Cara gampang scrap gugel

Discussion in 'Pemrograman Web' started by mp3online, Dec 10, 2013.

  1. gudel

    gudel Ads.id Pro

    Joined:
    Dec 13, 2012
    Messages:
    269
    Likes Received:
    24
    Contoh aja XPathDOM

    PHP:
    <?php
    $key 
    'usher';
    $html 'http://www.google.com/search?q='.urlencode($key).'+mp3';

    //CURL
    $ch curl_init(); 
    curl_setopt($chCURLOPT_URL $html ); 
    curl_setopt($chCURLOPT_RETURNTRANSFER 1);
    curl_setopt($chCURLOPT_USERAGENT "Opera/9.80 (J2ME/MIDP; Opera Mini/9.80 (S60; SymbOS; Opera Mobi/23.348; U; en) Presto/2.5.25 Version/10.54" );
    $data curl_exec($ch); 

    //XPATHDOM
    $dom = new DOMDocument;
    @
    $dom->loadHTML($data);
    $x = new DOMXPath($dom);
    $query "//div[@id='ires']/ol//h3/a";
    $a $x->query($query);
    foreach(
    $a as $node) {
        
    $link $node->getAttribute("href");
        
    parse_str($link,$t);
        
    $text $node->nodeValue;
        echo 
    '<a href="'.$t['/url?q'].'">'.$text.'</a><br>';
        
    }  
    ?>
     
    antotok likes this.
  2. gudel

    gudel Ads.id Pro

    Joined:
    Dec 13, 2012
    Messages:
    269
    Likes Received:
    24
    Pake loop FOR
    PHP:
    <?php
    //XPATHDOM
    $dom = new DOMDocument;
    @
    $dom->loadHTML($data);
    $x = new DOMXPath($dom);
    $query "//div[@id='ires']/ol//h3/a";
    $a $x->evaluate($query);
    for (
    $i 0$i $a->length$i++) {
        
    $item $a->item($i);
        
    $link $item->getAttribute("href");
        
    parse_str($link,$t);
        
    $text $item->nodeValue;
        echo 
    '<a href="'.$t['/url?q'].'">'.$text.'</a><br>';
    }  
    ?>
    Hasilnya sm sj dg loop foreach. Utk parsing yg lbh komplek susah klo pke DOM. Mending pke regex.
     
  3. whandi

    whandi Super Hero

    Joined:
    Dec 16, 2007
    Messages:
    2,954
    Likes Received:
    263
    Location:
    Pontianak
    thanks gan atas sharenya... siapa tau nanti bermanfaat untuk blogs baru ane.
     
  4. rexcarnation

    rexcarnation Hero

    Joined:
    Jul 11, 2013
    Messages:
    560
    Likes Received:
    26
    Location:
    Sidoarjo
    Mantap nih. Buat referensi aah.. :D
     
  5. icigo.gotei13

    icigo.gotei13 Hero

    Joined:
    Jun 5, 2010
    Messages:
    588
    Likes Received:
    36
    Location:
    Indonesia
    wah, kalau mau scrap images, terus images nya langsung disimpen bisa ga ya?
     
  6. mp3online

    mp3online Super Hero

    Joined:
    Jul 19, 2011
    Messages:
    2,228
    Likes Received:
    294
    Location:
    jakarta
    bisa aja.
    pake file_put_contents atau pake fputs atau pake curl jg bisa
     
  7. ORANGBANDUNG

    ORANGBANDUNG Ads.id Pro

    Joined:
    Feb 21, 2013
    Messages:
    304
    Likes Received:
    5
    contoh php sekalian mas hehe
     
  8. mp3online

    mp3online Super Hero

    Joined:
    Jul 19, 2011
    Messages:
    2,228
    Likes Received:
    294
    Location:
    jakarta
    cari di gugel banyak kok :)
     
  9. andiklive

    andiklive Super Hero

    Joined:
    Feb 4, 2012
    Messages:
    1,569
    Likes Received:
    103
    Location:
    Kurniawan Technologies
    kalau pake proxy gimana mas caranya, ada reference buat di pelajari gak.

    kalau gak berkenan, lewat PM juga gak papa :D
     
  10. mp3online

    mp3online Super Hero

    Joined:
    Jul 19, 2011
    Messages:
    2,228
    Likes Received:
    294
    Location:
    jakarta
    kl pake snoopy:
    $snoopy->proxy_host = ipnya;
    $snoopy->proxy_port = portnya;

    kl curl pake
    curl_setopt($ch, CURLOPT_PROXY, 'ip:port');
     
    andiklive likes this.
  11. Uya Jelek

    Uya Jelek Super Hero

    Joined:
    Jul 28, 2009
    Messages:
    847
    Likes Received:
    51
    Location:
    Tanah Grogot, Kaltim
    Ane tunggu masaknya aja deh gan untuk di pajang di WP hehehe.....
     
  12. deniel

    deniel Ads.id Fan

    Joined:
    Mar 29, 2010
    Messages:
    161
    Likes Received:
    8
    Mantap gan sharenya..
    Bisa buat inspirasi aplikasi ane. :D
     
  13. drunkz

    drunkz Ads.id Starter

    Joined:
    Sep 2, 2012
    Messages:
    93
    Likes Received:
    2
    pertanyaan ane cuman 1 gan, pake url itu ntar bisa kena chapta atau access lock google ga dengan frekuensi graps/detik ?
     
  14. drunkz

    drunkz Ads.id Starter

    Joined:
    Sep 2, 2012
    Messages:
    93
    Likes Received:
    2
    oooh, ts lom pernah nyoba klo trafick rame bgt brarti.klo pake proxy kurang mantep coz mase harus grap proxy, check proxy, trus blom lgi klo proxynya kena ban ip google jg.tp thanks dah share :D
     
  15. mp3online

    mp3online Super Hero

    Joined:
    Jul 19, 2011
    Messages:
    2,228
    Likes Received:
    294
    Location:
    jakarta
    blm pernah soalnya gak punya web yg trafiknya rame :)
    tapi dulu pernah make itu di webku yg bisa menghasilkan $5 per hari dari gugel adsense, tp waktu itu gak pasang histat & semacamnya jd gak tau pasti trafiknya brapa.
    kayaknya kl penghasilan segitu trafiknya jg udah lumayan rame :)
     
  16. WAhyu Chool

    WAhyu Chool Ads.id Pro

    Joined:
    Nov 17, 2012
    Messages:
    425
    Likes Received:
    22
    Location:
    Sijunjung, Sumatera Barat, Indonesia, Indonesia
    Cuma bisa melotot, mastah2 lagi bahas apaan yak? nasiib nubi :D
     
  17. Spiderboy

    Spiderboy Newbie

    Joined:
    Dec 9, 2013
    Messages:
    32
    Likes Received:
    0
    nggak semua paham maksud TS, penjelasan kurang jelas
     
  18. mp3online

    mp3online Super Hero

    Joined:
    Jul 19, 2011
    Messages:
    2,228
    Likes Received:
    294
    Location:
    jakarta
    biar paham langsung praktekin aja boss.
    itu tambahi foreach($array as $link) { echo $link; }
    ntar jg tau maksudnya.
    script yg aku share itu cuma contoh aja, kalau dijelasin secara fulgar ntar kena garuk om momod dikenain pasal AGC :D
     
  19. 70674

    70674 Ads.id Starter

    Joined:
    Oct 20, 2011
    Messages:
    58
    Likes Received:
    0
    maklum nubi ane gak paham :)) itu script diapain mastah? disave trus diuplot ke hosting apa disisipkan disalah satu file2 wp ato gimana :D
     
  20. bozmyeat

    bozmyeat Ads.id Starter

    Joined:
    Jan 19, 2013
    Messages:
    71
    Likes Received:
    0
    Location:
    South Korea
    apa gak di todong capcay..klo trefik udah gila2an...btw mau nanya buat auto2an selain pake bing n google pake apa aja ya....kemaren mau nyobo Apinya Naver mumett bahasanya :pusing::pusing: (bahasa korea)
     

Share This Page