Skip to main content

WebBots

Image Mining Webbot:
john@john-asus:~/Webbot$ cat Download_Images_From_Site.php 

# This is an attempt to download all the images from www.johnbebo.com (the background)
include("LIB_parse.php");          // include parse library to split off gifs
include("LIB_http.php");           // include curl library---good test to see if installed

// Get the Webpage
$web_page = http_get($target="http://www.johnbebo.com", $referer="");

// Parse the Image Tags
$meta_tag_array = parse_array($web_page['FILE'], "");

// Echo the image source attribute from each image tag
for($xx=0; $xx
  {
  $name = get_attribute($meta_tag_array[$xx], $attribute="src");
  #echo $target ."/"; echo $name ."\n";
  # DO SOMETHING HERE TO OUTPUT IMAGE
  echo $target ."/"; echo $name ." is stored\n";
  }

?>

Snarf a Webpage WebBot:
john@john-asus:~/Webbot$ cat Get_Page_johnbebo.php 

# Define the file you want to download
# Can just greatergreater this to a file to store locally
$target = "http://www.johnbebo.com";
$file_handle = fopen($target, "r");

# fetch the file
while (!feof($file_handle))
     echo fgets($file_handle, 4096);
fclose($file_handle);
?>


Show Images on Website WebBot:
john@john-asus:~/Webbot$ cat Show_Images_on_Site.php 

# This is an attempt to download all the gifs on www.johnbebo.com (the background)
include("LIB_parse.php");          // include parse library to split off gifs
include("LIB_http.php");           // include curl library---good test to see if installed

// Get the Webpage
$web_page = http_get($target="http://www.johnbebo.com", $referer="");

// Parse the Image Tags
$meta_tag_array = parse_array($web_page['FILE'], "");

// Echo the image source attribute from each image tag
for($xx=0; $xx
  {
  $name = get_attribute($meta_tag_array[$xx], $attribute="src");
  echo $name ."\n";
  }

?>

Comments

Popular posts from this blog

atftpd vs tftpd-hpa

Recently I was trying to tftp files from a Windows computer to a Kali box.   One version of Windows worked, but another didn't.    After much troubleshooting, here were my symptoms:

I could tftp a file from-to any Kali box from-to another Kali box
I could NOT tftp files to a specific Windows 7 box from any Kali box
I could NOT tftp files to a Chrooted-Ubuntu-Chromebook box from a Kali box

After MUCH troubleshooting, going through every setting in atftpd, it seemed like it literally was a client OS problem.  Different clients simply would not download files---unacceptable.

Thus, I switched to tftpd-hpa.   To install:
apt-get install tftpd-hpa

files go to/come from /srv/tftp, but it needs to be a tftp user. Thus, I needed to:
chroot -R /srv/tftp

Also, if you want to be able to put files ON the tftp server (from a client), you need to modify /etc/default/tftpd-hpa:
change "TFTP_OPTIONS="--secure" to "TFTP_OPTIONS="--secure --create"

I also changed the IP li…

ADS-B plotting with Kali (and other SDR goodies)

Recently I wanted to try some Software Defined Radio stuff.   
I had a RTL-SDR, FM+DAB, DVB-T USB Stick Set with RTL2832U & R820T. that I got from: http://www.amazon.com/gp/product/B00C37AZXK/ref=oh_details_o04_s00_i00?ie=UTF8&psc=1
But, even though this dongle would break out FM radio stations, and ATC frequencies (like the local Ground Control, tower, and even ATIS), which was cool, it wouldn't break out ADS-B.   
Thus, I bought a Vantech Green Mini RTL2832U R820T DVB-T SDR DAB FM USB DIGITAL TV Tuner Receiver RTL-SDR Project + DAB dongle Tuner MCX Input from Amazon, and tried this.  
This dongle was able to listen to the 1090MHz frequency required for ADS-B (as it goes from 25MHz to 1700MHz).  There were tons of Windows programs out there for breaking out and plotting ADS-B Mode S broadcasts, but not many for Linux.  
For Kali Linux, here's how I got it running and plotting planes around my home:
0) before you start, you should do an apt-get update to ensure you hav…

Temper Temperature monitor on a Beaglebone Black

Beaglebone Black as a temperature monitor:

Recently I wanted to monitor the temperature of my shed.  I thought I'd use a small computer such as a Raspberry Pi or a Beaglebone or Odroid.

My Raspberry Pi boxes were all in use, so I grabbed my Beaglebone, which was doing nothing.

I flashed it with the Debian9.32018-03-054GB SDIoTimage, but that seemed like it was running lots of bloatware and the ethernet interface wouldn't take a static IP with /etc/network/interfaces.

So I went with the Debian9.32018-01-284GB SDLXQTi image instead.  I still had the same problem, that lots of junk was running, and I couldn't configure my interface by modifying /etc/network/interfaces

So my first step was to get rid of all the bloatware.  If you're using a Raspberry Pi or something, you can skip this and just go to the second step below

STEP 1--Remove Blotatware from Beaglebone Black:

With some searching, I came across this post:
https://www.linuxquestions.org/questions/linux-newbie-8/inte…