labunix's blog

labunixのラボUnix

消費者庁の「悪質な海外ウェブサイト一覧」からURL一覧を取得してみた。

■消費者庁の「悪質な海外ウェブサイト一覧」からURL一覧を取得してみた。

 ネタ元は以下。

 [シェル芸]消費者庁が発表した悪質な海外ウェブサイト一覧からURLを抽出する
 http://nullpopopo.blogcube.info/2014/11/20141112_pdf2text.html

■pdfgrepにはwebサイトを直接見に行くことは出来ないので、wgetでダウンロード。
 一回目。

$ wget "http://www.caa.go.jp/adjustments/pdf/141031adjustments_1.pdf"; \
  pdfgrep "http" "141031adjustments_1.pdf"
・消費者庁越境消費者センター(http://www.cb-ccj.caa.go.jp/)
1    GUCCI                  http://www.guccimenjpsale.com/
2    bestmonclerjp.com      http://www.bestmonclerjp.com/
3    Nikeja.Com             http://www.nikeja.com/
4    HANBAINIHON.COM        http://www.hanbainihon.com/
5    lucas-lvbag.com 株式会社 http://www.lucas-lvbag.com/index.htm/
6    激安コーチバッグ専門店            http://www.coachgardens.com/
7    スニーカー専門店               http://gutebaby.com/
8    株式会社 JAPANSNEAK        http://www.sneakersjapanu.com/
9    コーチ専門販売店               http://www.coachhot2013.com/
10   ナイキアウトレット店             http://www.nikesjpz.com/
11   nikeadidasjp           http://www.nikeadidasjpz.com/
12   株式会社 AOVIS             http://aovins.com/
13   nikeonlinejapan.com    http://www.nikeonlinejapan.com/
14   coachya2013            http://www.coachya2013.com/
15   Rakutenku              http://www.rakutenku.com/
16   Chibauni               http://www.chibauni.com/
17   StyleJa.com            http://styleja.com/
18   jennus.com             http://jennus.com/
                            http://www.saifudesigner.com/
19   Saifudesigner.com      http://www.becausetheyknow.com/
                            http://www.pandplimo.com/
20   i-you-i                http://i-you-i.com/
21   vanlai                 http://www.vanlai.com/
22   kikuku                 http://kikuku.net/
23   アグ ブーツ店舗               http://www.ugg-kakaku.com/
24   TORYBURCH               http://www.toribachija.com/
25   靴・専門店                   http://kutu.fenyastravels.com/
26   www.tuffymaps.com       http://www.tuffymaps.com/
                             http://www.diogene99.com/burberry.html
                             http://www.バーバリーアウトレット.com/
28   UGG 専門販売店               http://www.blgoddard.com/
29   guccistore              http://www.2013guccistorejp.com/
30   shinesneaker            http://www.shinesneaker.com/
31   bripli1111              http://www.brepli111.com/
32   アグ・オーストリア.              http://www.smetn.com/
33   UGG 屋                   http://www.m1700.com/
34   UGG australia           http://www.uggboots.jp/
35   UGG                     http://nutrired.org/ui3/index.php?p=3854
36   楽市                      http://abassjp.com/M.htm
37   Enlvs shopping          http://www.enlvs.com/
38                           http://www.top-kopi.net/
                             http://emails.brandheya.com/
                             http://brandheya.com/
                             http://brandheyajp.com/                    bag,
                             http://www.brandheyajp.com/
40   ktokopi                 http://www.ktokopi.com/
41   louis-360               http://louis-360.com/
42   BURBERRY LONDON         http://www.burberrybluelabeljpsale.com/
43   celine                  http://www.celine-japan.com/
44   PICK-GOLF UP            http://www.pickgolfup.com/
http://www.newmoncleroutletjpn.com
46   LV BAG ON SELL         http://www.lvbagonsale.com/
47                          http://www.aftpq.com/
48   DUVETICA               http://jp.wek7.org/duvetica
49                          http://www.toshop-jp.com
50   monclerdown2014        http://www.monclerdown2014.com/
51   Moncler-outlets.net    http://www.moncler-outlets.net/
52                          http://www.montblanc-ballpen.com
53   Brandedcorner          http://www.brandedcorner.com/index.php
54   Eurocentric            http://www.eurocentrichandbags.com
55   www.hamalibg.biz       http://www.hamalibg.biz/
56   CARTOOLPLAZA           http://cartoolplaza.com/
57   C-web 株式会社             http://www.c-web.biz/
58   saleonlinejapan        http://saleonlinejapan.com/
59   www.casio.l1ids.org    http://www.casio.l1ids.org/
60   www.monopolysalejp.com http://www.monopolysalejp.com
61   brandedcorner.com      http://www.brandedcorner.com/
62   ブランド館V                 http://www.gaga-diy.com
63   brand-0k.com           http://www.brand-0k.com/index.htm
64   JJKOPI                 http://www.jjkopi.com/
65   haogtailvf             http://www.momocak.com/
66   Louis Vuitton          http://www.bags-ladies.com/
67   MONCLER                http://www.2014monkureru.com/
68   UGG Boots              http://www.uggaustralia-jp.asia/
69                          http://www.esprogramming.com
70                          http://www.jimmychooonlinejapan.com
71   腕時計本舗                  http://www.wristwatchsalerep.com/
72   Lvutt 激安店              http://www.lvutt.com/
73   VUITTONFANS.COM        http://www.vuittonfans.com/
74                          http://www.vuittonu.com/
75   モンブラン通販専門店             http://www.montblancshop.cc/
76   UGGboots               http://www.rexvod.com/
77   UGG                    http://www.northlandtimeshares.com/
78   COACH saleeast.com     http://www.coachjust.com/
79   モンクレール割引専門店            http://www.jojoeheaven.org
80                          http://www.iphone5casesjp.com
81   LONGCHAMP              http://www.longchampukhandbags.com/
82   プラダアウトレット               http://www.bagsyo.com/
http://www.palazzogrimani.org/wp-classjp.php
84   shoppingmaniaoutlet     http://www.shoppingmaniaoutlet.com/
85   babygoodsshopoutlet.com http://babygoodsshopoutlet.com/
86   yasuishopping           http://www.yasuishoppu.com/
87                           http://www.amandabeamer.com/
88   ブランド家族株式会社              http://www.jpzizi.com/
89   boots1000.com           http://www.boots1000.com/
90   UGG 専門販売店               http://www.buyuggcheap.com/
91   Marmot                  http://www.shopmarmotjp.com/
92   JAPANGO 水着              http://www.iphoneswitch.com/
93   C othes                 http://www.iphonesweep.com/
94   MONCLER                http://www.scoopy-doos.com/
95                          http://www.outcomesfas.com/
96   JapanBaggu             http://www.japanbaggu.com/
97   shoppemallmarts        http://www.shoppemallmarts.com/
98   テニス専門店                 http://www.yazya.biz
99   株式会社 ライフ               http://www.nikon-live.com/
100                         http://www.armani-jp.com/
101  MONCLER                http://www.2013monkureru.com/
102                         http://www.burberryjapan.net/
103  ドリームハウス                http://www.jagranados.com
104  フェリージ大特価               http://www.felisihannbai.com/
105  brandskiaccessories    http://www.brandskiaccessories.com/
106  bookingsatlas           http://www.bookingsatlas.com/
107  株式会社モンクストリ              http://www.hermes2014.in/
108                          http://www.bag-hermes.com/
109  COACH                   http://www.coachwallets-jp.info/
110  www.j5sf.com            http://www.j5sf.com
111  golfonhome.com          http://www.golfonhome.com/
112  jonpoor 屋               http://www.jonpoor.com
113  kawaiyukinobutsu        http://kawaiyukinobutsu.com/
114                          http://www.coachbaguu.com/
115  靴ブランド総合サイト              http://jpkutucharm.com/
116  LOUIS VUITTON           http://www.wholesalelouisvuitton-japan.biz
http://www.フェラガモアウトレット.com/
118  VIPLUXURYSHOPPEVIP     http://www.vipluxuryshoppevip.com/
119                         http://www.flighttocapetown.com/
120  kushyma.com            http://kushyma.com/
121  www.antaraarts.org     http://www.antaraarts.org/
122  Love-bag               http://www.love-bag.net/
123  Louis Vuitton          http://www.louis-vuittonsale.info
124  samantha               http://www.samanthasale.info/
125  cineotro SHOP          http://www.cineotro.com/index.html
126  shoppemallmarts        http://shoppemallmarts.com/
127  Kingsofshoes           http://kingsofshoes.com
128  株式会社 sukigo            http://www.sukigo.com/
129  genten                 http://www.storegentenjpsale.com/
130  brandfu666             http://www.burandofu8899.com/
                            http://xn--jck7c4a7b0a9km64tjqzbdoc5r1k.jp/
131                         http://www.replicaunifomushop.com/
                            http://www.unifomushop.com/
132  エルメス 日本(直営店)           http://jp-store-hermes.com/
133  Ray-Ban Store          http://www.rb-pickoutlet.com/
134  brandshopsshopping.com http://brandshopsshopping.com/
135  Vivienne Westwood      http://audiocentergt.com/
136                         http://www.johnstonsjp.com/
137  ブルガリ アウトレット屋           http://www.bvlgarijapan.com/
138  bvlgarijapan.info      http://www.bvlgarijapan.info/
139  株式会社モンクストリ             http://www.chloebagsoutlet.info/
140  一番メンズクラブ販売店            http://www.lv-guccl88.com/
141  匠 BUY WATCH SHOP       http://superwatch1.com/index.html
142  Replicajp.com          http://www.watch9.com/
143  Loving Kopi            http://www.kopigoods.com/default.htm
144  MAIKIKI 周辺機器屋          http://www.maikiki.com/
145  ブランド専門店                http://www.oneminuteplayfestival.org/
146  グッチ店舗                  http://www.guccipursejp.info/
147  株式会社 Renewingfaces     http://www.renewingfaces.com/
148  Import Brand           http://www.topmalltrade-blng.com/
149  ポドロック                  http://www.japanbagskan.com/
150  ブランド家族株式会社             http://www.jpzizi.com/
151  激安店 BIRKENSTOCK        http://birukenbuyma.com/
152  www.eakonshop.com      http://www.eakonshop.com/
153  STYLE FILE             http://www.lkjy.net/
154  chloe 激安店              http://www.chloesale.pw/
155                         http://teddyni.com/p-aboutus.html
156  searchlik              http://www.searchlik.com/
157  Aquatas,Inc-腕時計        http://aquatas.com/
158  loveyoushoppu.com      http://www.loveyoushoppu.com/
159                         http://www.americanpunjabitribune.com/
160  VOGANA                 http://www.ozkaltd.com/
161  Sweet Baby             http://www.edu-huayu.com/index.html
162                         http://www.webidx.net/
163  musumenohigifuto.com   http://musumenohigifuto.com
164  激安ブランド                 http://www.likekopi.com/Default.html
165  株式会社 Renewingfaces      http://www.renewingfaces.com/
166  6fos                    http://6fos.com
167  AXES                    http://www.dinermuseum.com/shippinginfo.html
168  株式会社 楽味屋                http://www.jpfigure.com/index.php
169  LIFE                    http://www.3i09.com
170  xreaderapp              http://www.xreaderapp.com/login.html
171  viviennebestjp          http://www.viviennebestjp.com
172  genten                  http://www.gentenshopjp.com
173  Celine 店舗               http://www.celineya.net/
174                          http://www.vuittonwaell.com/
175  ブランドパリス                 http://www.brandparis6.com/
176  HYCOPYS                 http://www.hicopys.net/
トリーバーチ専門販売店            http://www.toryburchoutlet.info/
178  時計正規サイト                http
179  SHOE SHOP              http://www.csmmetalmart.com/
180                         http://www.avongouis.com/
181  shoppefaithsvip        http://www.shoppefaithsvip.com
182  Kr1shijue              http://www.youthshopcentrejp.com/
183  ATELIER PARIS          http://www.jp-louisvuitton.com/
184  FASHION LAND           http://www.bandfashions.com/
185  jokojp.com             http://www.jokojp.com
186                         http://www.cnboee.com/shop/products/1025.html
187  VUITTONBOX             http://www.vuittonbox.com/
188  BESTCOPYS              http://www.bestcopys.com/
189                         http://www.buyna.net/
190  GUCCI YA               http://www,gucchiya.com/
191  PRADA                  http://www.pradabagsale.info/
192  burberrypolo.eu        http://burberrypolo.eu/
193  lcmbilgimerkezi        http://www.lcmbilgimerkezi.com
194  Caycecole、lnc-COACH    http://www.caycecole.com
195  ecznuons.com           http://www.ecznuons.com/
196  tumi.wsualumuicard.com http://tumi.wsualumuicard.com
197  cheapflights-air.com   http://cheap-flightsair.com/
198                         http://www.icoolauto.com/
199                         http://www.jphareru.com/
200                         http://genuinelouisvuitton.com
201  WATCHES 激安店             http://www.urbntouch.com/
202                          http://www.4pixsake.com/about_us.html
203                          http://www.uthotels.biz
204  www.kurvstudios.net     http://www.kurvstudios.net/
205  onlineshop              http://www.educatlvosmultimedia.com/
206  正規商品専門店                 http://www.stylesfashionstore.com/
207  selectshop mogoone      http://www.flagshipband.com/
208  asazunet.com            http://www.asazunet.com/-ezp-14.html
     収納宅配館                   http://www.rackanshop.pw/
     リコメン堂 本館                http://www.myrcmd.pw
     Kimaira,Inc 株式会社        http://www.aldantownwatch.com/
                             http://www.urbntouch.com/
     シカゴ                    http://www.nksclub.com/
     New 激安店                http://www.dragontechs.com/
                            http://cynergyper4mers.com/
     efgkbp.com             http://www.efgkbp.com/
                            http://www.mamairma.info/
     ブランド天国                 http://www.seecurrent.asia/

■余分なものを除去して整列。
 2回目。

$ pdfgrep "htt[ps]*://" "141031adjustments_1.pdf" | \
  sed s%".*\(http://\)"%"\1"%g | grep -v ")\|http://\$" | \
  awk '{print $1}' | sort
http://6fos.com
http://abassjp.com/M.htm
http://aovins.com/
http://aquatas.com/
http://audiocentergt.com/
http://babygoodsshopoutlet.com/
http://birukenbuyma.com/
http://brandheya.com/
http://brandheyajp.com/
http://brandshopsshopping.com/
http://burberrypolo.eu/
http://cartoolplaza.com/
http://cheap-flightsair.com/
http://cynergyper4mers.com/
http://emails.brandheya.com/
http://genuinelouisvuitton.com
http://gutebaby.com/
http://i-you-i.com/
http://jennus.com/
http://jp-store-hermes.com/
http://jp.wek7.org/duvetica
http://jpkutucharm.com/
http://kawaiyukinobutsu.com/
http://kikuku.net/
http://kingsofshoes.com
http://kushyma.com/
http://kutu.fenyastravels.com/
http://louis-360.com/
http://musumenohigifuto.com
http://nutrired.org/ui3/index.php?p=3854
http://saleonlinejapan.com/
http://shoppemallmarts.com/
http://styleja.com/
http://superwatch1.com/index.html
http://teddyni.com/p-aboutus.html
http://tumi.wsualumuicard.com
http://www,gucchiya.com/
http://www.2013guccistorejp.com/
http://www.2013monkureru.com/
http://www.2014monkureru.com/
http://www.3i09.com
http://www.4pixsake.com/about_us.html
http://www.aftpq.com/
http://www.aldantownwatch.com/
http://www.amandabeamer.com/
http://www.americanpunjabitribune.com/
http://www.antaraarts.org/
http://www.armani-jp.com/
http://www.asazunet.com/-ezp-14.html
http://www.avongouis.com/
http://www.bag-hermes.com/
http://www.bags-ladies.com/
http://www.bagsyo.com/
http://www.bandfashions.com/
http://www.becausetheyknow.com/
http://www.bestcopys.com/
http://www.bestmonclerjp.com/
http://www.blgoddard.com/
http://www.bookingsatlas.com/
http://www.boots1000.com/
http://www.brand-0k.com/index.htm
http://www.brandedcorner.com/
http://www.brandedcorner.com/index.php
http://www.brandheyajp.com/
http://www.brandparis6.com/
http://www.brandskiaccessories.com/
http://www.brepli111.com/
http://www.burandofu8899.com/
http://www.burberrybluelabeljpsale.com/
http://www.burberryjapan.net/
http://www.buyna.net/
http://www.buyuggcheap.com/
http://www.bvlgarijapan.com/
http://www.bvlgarijapan.info/
http://www.c-web.biz/
http://www.casio.l1ids.org/
http://www.caycecole.com
http://www.cb-ccj.caa.go.jp/)
http://www.celine-japan.com/
http://www.celineya.net/
http://www.chibauni.com/
http://www.chloebagsoutlet.info/
http://www.chloesale.pw/
http://www.cineotro.com/index.html
http://www.cnboee.com/shop/products/1025.html
http://www.coachbaguu.com/
http://www.coachgardens.com/
http://www.coachhot2013.com/
http://www.coachjust.com/
http://www.coachwallets-jp.info/
http://www.coachya2013.com/
http://www.csmmetalmart.com/
http://www.dinermuseum.com/shippinginfo.html
http://www.diogene99.com/burberry.html
http://www.dragontechs.com/
http://www.eakonshop.com/
http://www.ecznuons.com/
http://www.edu-huayu.com/index.html
http://www.educatlvosmultimedia.com/
http://www.efgkbp.com/
http://www.enlvs.com/
http://www.esprogramming.com
http://www.eurocentrichandbags.com
http://www.felisihannbai.com/
http://www.flagshipband.com/
http://www.flighttocapetown.com/
http://www.gaga-diy.com
http://www.gentenshopjp.com
http://www.golfonhome.com/
http://www.guccimenjpsale.com/
http://www.guccipursejp.info/
http://www.hamalibg.biz/
http://www.hanbainihon.com/
http://www.hermes2014.in/
http://www.hicopys.net/
http://www.icoolauto.com/
http://www.iphone5casesjp.com
http://www.iphonesweep.com/
http://www.iphoneswitch.com/
http://www.j5sf.com
http://www.jagranados.com
http://www.japanbaggu.com/
http://www.japanbagskan.com/
http://www.jimmychooonlinejapan.com
http://www.jjkopi.com/
http://www.johnstonsjp.com/
http://www.jojoeheaven.org
http://www.jokojp.com
http://www.jonpoor.com
http://www.jp-louisvuitton.com/
http://www.jpfigure.com/index.php
http://www.jphareru.com/
http://www.jpzizi.com/
http://www.jpzizi.com/
http://www.kopigoods.com/default.htm
http://www.ktokopi.com/
http://www.kurvstudios.net/
http://www.lcmbilgimerkezi.com
http://www.likekopi.com/Default.html
http://www.lkjy.net/
http://www.longchampukhandbags.com/
http://www.louis-vuittonsale.info
http://www.love-bag.net/
http://www.loveyoushoppu.com/
http://www.lucas-lvbag.com/index.htm/
http://www.lv-guccl88.com/
http://www.lvbagonsale.com/
http://www.lvutt.com/
http://www.m1700.com/
http://www.maikiki.com/
http://www.mamairma.info/
http://www.momocak.com/
http://www.moncler-outlets.net/
http://www.monclerdown2014.com/
http://www.monopolysalejp.com
http://www.montblanc-ballpen.com
http://www.montblancshop.cc/
http://www.myrcmd.pw
http://www.newmoncleroutletjpn.com
http://www.nikeadidasjpz.com/
http://www.nikeja.com/
http://www.nikeonlinejapan.com/
http://www.nikesjpz.com/
http://www.nikon-live.com/
http://www.nksclub.com/
http://www.northlandtimeshares.com/
http://www.oneminuteplayfestival.org/
http://www.outcomesfas.com/
http://www.ozkaltd.com/
http://www.palazzogrimani.org/wp-classjp.php
http://www.pandplimo.com/
http://www.pickgolfup.com/
http://www.pradabagsale.info/
http://www.rackanshop.pw/
http://www.rakutenku.com/
http://www.rb-pickoutlet.com/
http://www.renewingfaces.com/
http://www.renewingfaces.com/
http://www.replicaunifomushop.com/
http://www.rexvod.com/
http://www.saifudesigner.com/
http://www.samanthasale.info/
http://www.scoopy-doos.com/
http://www.searchlik.com/
http://www.seecurrent.asia/
http://www.shinesneaker.com/
http://www.shopmarmotjp.com/
http://www.shoppefaithsvip.com
http://www.shoppemallmarts.com/
http://www.shoppingmaniaoutlet.com/
http://www.smetn.com/
http://www.sneakersjapanu.com/
http://www.storegentenjpsale.com/
http://www.stylesfashionstore.com/
http://www.sukigo.com/
http://www.top-kopi.net/
http://www.topmalltrade-blng.com/
http://www.toribachija.com/
http://www.toryburchoutlet.info/
http://www.toshop-jp.com
http://www.tuffymaps.com/
http://www.ugg-kakaku.com/
http://www.uggaustralia-jp.asia/
http://www.uggboots.jp/
http://www.unifomushop.com/
http://www.urbntouch.com/
http://www.urbntouch.com/
http://www.uthotels.biz
http://www.vanlai.com/
http://www.vipluxuryshoppevip.com/
http://www.viviennebestjp.com
http://www.vuittonbox.com/
http://www.vuittonfans.com/
http://www.vuittonu.com/
http://www.vuittonwaell.com/
http://www.watch9.com/
http://www.webidx.net/
http://www.wholesalelouisvuitton-japan.biz
http://www.wristwatchsalerep.com/
http://www.xreaderapp.com/login.html
http://www.yasuishoppu.com/
http://www.yazya.biz
http://www.youthshopcentrejp.com/
http://www.バーバリーアウトレット.com/
http://www.フェラガモアウトレット.com/
http://xn--jck7c4a7b0a9km64tjqzbdoc5r1k.jp/

■226件。

$ pdfgrep "htt[ps]*://" "141031adjustments_1.pdf" | \
  sed s%".*\(http://\)"%"\1"%g | grep -v ")\|http://\$" | \
  awk '{print $1}' | sort | wc -l
226