This will be a short post – I guess Code School must make minor changes to their user profile code about this time each year, as it was just a year ago that I had to update this code.
For the codeschool.php file, change this:
/* disabling the anchor tags on each badge by changing to divs */
$full_content = str_replace("<a href","<div class",$full_content);
$full_content = str_replace("</a>","</div>",$full_content);
to this:
/* disabling the anchor tags on each badge by changing to divs */
$full_content = str_replace("<a rel=\"tooltip\" ","<div ",$full_content);
$full_content = str_replace("href=\"/learn","data-href=\"http://codeschool.com/learn",$full_content);
$full_content = str_replace("</a>","</div>",$full_content);
This will eliminate the links that would be intended to point at the Code School paths, but instead end up being broken links pointing at your own site.
UPDATE: This does not currently work, as DataCamp has changed the structure of profile pages. I will revise this as soon as is feasible. (7/26/17)
Just as I have written scripts for displaying report cards for Code School, CodeEval, and Duolingo on my blog, I have written the below script for displaying a DataCamp profile.
datacamp.php:
<style>
#datacamp {
border: 1px solid blue;
text-align: center;
vertical-align: middle;
width: 100%;
}
#datacamp li {
list-style-type: none;
}
.image-centered {
display:block;
margin-left: auto;
margin-right: auto;
margin-bottom: 10px;
}
.image-rounded {
border-radius: 50%;
}
.progress-bar {
position: relative;
border: 1px solid #33aacc;
width: 100%;
height: 18px;
margin-bottom: 1rem;
}
.progress-bar .inner {
position: absolute;
left: 0;
top: 0;
bottom: 0;
background-color: #33aacc;
min-width: 5px;
}
.wrapper-scores .container {
min-width: 150px;
max-width: 260px;
width: 100%;
}
.course-block__completed, .course-block__certificate-download, .btn-linkedin-share,
.course-block__description, .course-block__author {
display: none;
}
.col-sm-4 img {
display: inline;
padding: 1px;
}
</style>
<?php
date_default_timezone_set('America/Los_Angeles');
function getClass($classname, $htmltext)
{
$dom = new DOMDocument;
$dom->loadHTML($htmltext);
$xpath = new DOMXPath($dom);
$results = $xpath->query("//*[@class='" . $classname . "']");
return $results;
}
function buildContent($results)
{
$content = "";
foreach ($results as $node) {
$partial_content = innerHTML($node);
$content = $content . $partial_content;
}
return $content;
}
/* this function preserves the inner content of the scraped element.
** http://stackoverflow.com/questions/5349310/how-to-scrape-web-page-data-without-losing-tags
** So be sure to go and give that post an uptick too 🙂
**/
function innerHTML(DOMNode $node)
{
$doc = new DOMDocument();
foreach ($node->childNodes as $child) {
$doc->appendChild($doc->importNode($child, true));
}
return $doc->saveHTML();
}
$profilename = $_GET['nick'];
if (strlen($profilename) == 0)
exit(1);
$profile_url = 'https://www.datacamp.com/profile/' . $profilename . '/';
$filename = "datacamp_" . $profilename . ".txt";
$full_content = '';
$norefresh = FALSE;
$days = 1;
$updated = 'no date';
/* checks to see if file exists and is current */
if (file_exists($filename)) {
$stats = stat($filename);
/* 86400 seconds in one day */
if ($stats[9] > (time() - (86400 * $days))) {
$norefresh = TRUE;
$updated = date("Y-m-d H:i:s", $stats[9]);
}
}
/* if $norefresh is still FALSE, file will be created or updated; otherwise, it will be loaded */
if ($norefresh) {
$full_content = file_get_contents($filename);
} else {
$previous_value = libxml_use_internal_errors(TRUE);
$context = stream_context_create(array(
'https' => array('ignore_errors' => true),
));
$html = file_get_contents($profile_url, false, $context);
$class = 'profile-page';
$resultsBucket = getClass($class,$html);
libxml_clear_errors();
libxml_use_internal_errors($previous_value);
$full_content = $full_content . buildContent($resultsBucket);
/* making sure correct path exists on images */
$full_content = str_replace("src=\"/","src=\"http://datacamp.com/",$full_content);
/* changing h2 tags to h1 tags and inserting line breaks */
$full_content = str_replace("<h2","<br /><h1",$full_content);
$full_content = str_replace("</h2>","</h1><br />",$full_content);
/* disabling the anchor tags on each badge by changing to divs */
$full_content = str_replace("<a href","<div class",$full_content);
$full_content = str_replace("<a class","<div class",$full_content);
$full_content = str_replace("</a>","</div>",$full_content);
/* adding line breaks */
$full_content = str_replace("<div class=\"stats\">","<br /><div class=\"stats\">",$full_content);
$full_content = str_replace("Earned</span>","Earned</span><br />",$full_content);
$full_content = str_replace("Completed</span>","Completed</span><br />",$full_content);
$full_content = str_replace("Aced</span>","Aced</span><br /><br />",$full_content);
file_put_contents($filename,$full_content);
$updated = date("Y-m-d H:i:s");
}
?>
<a href="<?php echo $profile_url; ?>" target="_blank">
<div class="wrapper-scores">
<!-- <?php echo "Last updated: $updated" ?> -->
<?php
/* return the html */
echo $full_content;
?>
</div>
</a>
If you wish to display this in a WordPress widget, create a Text widget and add this code, replacing “NICKNAME” with a DataCamp username.
Since my primary reason for writing these has been to populate widgets on this WordPress blog, at some point I’ll probably incorporate these into WP plugins.
Though I wouldn’t call this an intractable problem, I did notice something annoying when looking at my Code School profile on the sidebar of this site.
Between the badges in the “Master Status” section, white dots had appeared! Upon inspecting these, I saw that these were the bullets on the list items that held the badges.
One article on Stack Overflow suggested that the CSS style for the tag for the unordered list that holds the list items should be include “list-style-type: none;”, but that seemed to have no effect.
After playing with the CSS a bit, I discovered that setting that property on the li tag instead fixed the problem.
Here is the corrected CSS code which updates the code from a past post:
Those who use WordPress may be familiar with Ping-O-Matic for keeping blog search engines updated whenever a new post is written.
I discovered that Bing had more of my posts indexed than any other search engine. I could manually submit the link for each post to Ping-O-Matic, but that would be no fun. Instead, I decided to automate the process.
Once you have the key, you can set up two files: the first is called bing_basic.html, and the second is bing_basic.php. These files are a mashup from the Bing Search API guide and a function created for sending pings to Ping-O-Matic.
<?php
/*
--------------------------------------------
$title contains the title of the page you're sending
$url is the url of the page
$debug true print out the debug and show xml call and answer
--------------------------------------------
the output is an array with two elements:
status: ok / ko
msg: the text response from pingomatic
--------------------------------------------
*/
function pingomatic($title,$url,$debug=false) {
$content='<?xml version="1.0"?>'.
'<methodCall>'.
' <methodName>weblogUpdates.ping</methodName>'.
' <params>'.
' <param>'.
' <value>'.$title.'</value>'.
' </param>'.
' <param>'.
' <value>'.$url.'</value>'.
' </param>'.
' </params>'.
'</methodCall>';
$headers="POST / HTTP/1.0\r\n".
"User-Agent: Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.1) Gecko/20090624 Firefox/3.5 (.NET CLR 3.5.30729)\r\n".
"Host: rpc.pingomatic.com\r\n".
"Content-Type: text/xml\r\n".
"Content-length: ".strlen($content);
if ($debug) nl2br($headers);
$request=$headers."\r\n\r\n".$content;
$response = "";
$fs=fsockopen('rpc.pingomatic.com',80, $errno, $errstr);
if ($fs) {
fwrite ($fs, $request);
while (!feof($fs)) $response .= fgets($fs);
if ($debug) echo "<xmp>".$response."</xmp>";
fclose ($fs);
preg_match_all("/<(name|value|boolean|string)>(.*)<\/(name|value|boolean|string)>/U",$response,$ar, PREG_PATTERN_ORDER);
for($i=0;$i<count($ar[2]);$i++) $ar[2][$i]= strip_tags($ar[2][$i]);
return array('status'=> ( $ar[2][1]==1 ? 'ko' : 'ok' ), 'msg'=>$ar[2][3] );
} else {
if ($debug) echo "<xmp>".$errstr." (".$errno.")</xmp>";
return array('status'=>'ko', 'msg'=>$errstr." (".$errno.")");
}
}
/****
* Simple PHP application for using the Bing Search API
*/
$acctKey = 'YourAccountKey';
$rootUri = 'https://api.datamarket.azure.com/Bing/Search';
// Read the contents of the .html file into a string.
$contents = file_get_contents('bing_basic.html');
if ($_POST['query'])
{
// Here is where you'll process the query.
// The rest of the code samples in this tutorial are inside this conditional block.
// Encode the query and the single quotes that must surround it.
$query = urlencode("'{$_POST['query']}'");
// Get the selected service operation (Web or Image).
$serviceOp = $_POST['service_op'];
// Construct the full URI for the query.
$requestUri = "$rootUri/$serviceOp?\$format=json&Query=$query";
// Encode the credentials and create the stream context.
$auth = base64_encode("$acctKey:$acctKey");
$data = array(
'http' => array(
'request_fulluri' => true,
// ignore_errors can help debug – remove for production. This option added in PHP 5.2.10
'ignore_errors' => true,
'header' => "Authorization: Basic $auth")
);
$context = stream_context_create($data);
// Get the response from Bing.
$response = file_get_contents($requestUri, 0, $context);
// Decode the response.
$jsonObj = json_decode($response);
$resultStr = '';
// Parse each result according to its metadata type.
foreach($jsonObj->d->results as $value) {
$pingresults = pingomatic($value->Url,$value->Description);
//$arrlength = count($pingresults);
//$resultStr .= $arrlength . "<br />\n";
//for($x = 0; $x < $arrlength; $x++) {
$resultStr .= $pingresults['status'] . "<br />\n";
$resultStr .= $pingresults['msg'] . "<br />\n";
//}
switch ($value->__metadata->type) {
case 'WebResult':
$resultStr .=
"<a href=\"{$value->Url}\">{$value->Title}</a><p>{$value->Description}</p>";
break;
case 'ImageResult':
$resultStr .=
"<h4>{$value->Title} ({$value->Width}x{$value->Height}) " . "{$value->FileSize} bytes)</h4>" . "<a href=\"{$value->MediaUrl}\">" . "<img src=\"{$value->Thumbnail->MediaUrl}\"></a><br />";
break;
}
}
// Substitute the results placeholder. Ready to go.
$contents = str_replace('{RESULTS}', $resultStr, $contents);
}
echo $contents;
?>
Put both files into the same folder on your website. When you open bing_basic.php in your browser, it should look something like this:
In my case, I wanted to get all the pages that Bing had indexed. I entered “site:deepinthecode.com” into the Query box and clicked Search.
After a moment, the page refreshed with the following results:
The “ok” status shows that the ping was received properly and the line below shows the status message. Following those lines are the hyperlinked post titles and the beginning of each post.
Had the ping not been received, the status would be “ko”, and the message would (hopefully) be descriptive of why the ping did not take.
The function in the PHP file can be modified for use with APIs other than the one for Ping-O-Matic, though I haven’t had time to make any changes there yet to see how well it will work with other sites.
