data

Southern Cross Computer Systems Wins IBM Beacon Award for Innovation in Green IT Data Center Solution

Southern Cross Computer Systems Pty Ltd has been named winner of the award for “Innovation in Green IT Data Center Solution” in the annual IBM Beacon Awards competition, honoring IBM Business Partners for their ingenuity, innovation, customer satisfaction and outstanding achievements in providing business solutions.




data

Polymath proposal: clearinghouse for crowdsourcing COVID-19 data and data cleaning requests

After some discussion with the applied math research groups here at UCLA (in particular the groups led by Andrea Bertozzi and Deanna Needell), one of the members of these groups, Chris Strohmeier, has produced a proposal for a Polymath project to crowdsource in a single repository (a) a collection of public data sets relating to […]




data

Final data is in the splitter queue.

As promised, we've stopped the process that puts new data into the queue today. Data distribution will continue until the files shown on the status pages are done. We'll be accepting results and resending results that didn't validate for a while.




data

Wimpie Nortje: Database migration libraries for PostgreSQL.

It may be tempting at the start of a new project to create the first database tables manually, or write SQL scripts that you run manually, especially when you first have to spend a significant amount of time on sifting through all the migration libraries and then some more to get it working properly.

Going through this process did slow me down at the start of the project but I was determined to use a migration tool because hunting inexplicable bugs that only happen in production just to find out there is a definition mismatch between the production and development databases is not fun. Using such a tool also motivates you to write both the setup and teardown steps for each table while the current design is still fresh in your mind.

At first I considered a standalone migration tool because I expect them to be very good at that single task. However, learning the idiosyncrasies of a new tool and trying to make it fit seamlessly into my development workflow seemed like more trouble than it is worth.

I decided to stick with a Common Lisp library and found the following seven that work with PostgreSQL and/or Postmodern:

I quickly discounted Crane and Mito because they are ORM (Object Relational Mapper) libraries which are way more complex than a dedicated migration library. Development on Crane have stalled some time ago and I don't feel it is mature enough for frictionless use yet. Mito declares itself as being in Alpha state; also not mature enough yet.

I only stumbled onto cl-mgr and Orizuru-orm long after making my decision so I did not investigate them seriously. Orizuru-orm is in any case an ORM which I would have discounted because it is too complex for my needs. CL-mgr looks simple, which is a good thing. It is based on cl-dbi which makes it a good candidate if you foresee switching databases but even if I discovered it sooner I would have discounted it for the same reason as CL-migrations.

CL-migrations looks very promising. It is a simple library focusing only on migrations. It uses clsql to interface with the database which bothered me because I already committed to using Postmodern and I try to avoid adding a lot of unused code to my projects. The positive side is that it interfaces to many different databases so it is a good candidate if you are not committed to using Postmodern. It is also a stable code base with no outstanding bug reports.

The two projects I focused on was Postmodern-passenger-pigeon and Database-migrations because they both use Postmodern for a database interface.

Postmodern-passenger-pigeon was in active development at the time and it seemed safer to use than Database-migrations because it can do dry runs, which is a very nice feature when you are upgrading your production database and face the possibility of losing data when things go awry. Unfortunately I could not get it working within a reasonable amount of time.

I finally settled on Database-migrations. It is a small code base, focused on one task, it is mature and it uses Postmodern so it does not pull in a whole new database interface into my project. There are however some less positive issues.

The first issue is a hindrance during development. Every time the migrations ASDF system (or the file containing it, as ASDF prefers that all systems be defined in a single file) is recompiled it adds all the defined migrations to the migrations list. Though each one will only be applied once to the DB it is still bothersome. One can then clear the list with (setf database-migrations::*migrations* nil) but then only newly modified migration files will be added. The solution then is to touch the .asd file after clearing the migrations list.

The second negative point is quite dangerous. The downgrade function takes a target version as parameter, with a default target of 0. This means that if you execute downgrade without specifying a target version you delete your whole database.

I am currently using Database-migrations and it works well for me. If for some reason I need to switch I will use cl-migrations.

Using Database-migrations

To address the danger of unintentionally deleting my database I created a wrapper function that does both upgrade and downgrade, and it requires a target version number.

Another practical issue I discovered is that upgrades and downgrades happen in the same order as they are defined in the migration file. If you create two tables in a single file where table 2 depends on table 1 then you can not revert / downgrade because Database-migrations will attempt to delete table 1 before table 2. The solution here is to use the def-queries-migration macro (instead of def-query-migration) which defines multiple queries simultaneously . If you get overwhelmed by a single definition that defines multiple tables the other option is to stick with one migration definition per file.




data

CRR: Where Data is (Tiger) King

#tigerkingnetflix         #tigerkingmemes   COVID-19 has flipped our world upside down. Whether you’re on the front lines of this global health crisis or doing your part by staying put, we are all coping with losses




data

COVID-Themed Lures Target SCADA Sectors With Data Stealing Malware

A new malware campaign has been found using coronavirus-themed lures to strike government and energy sectors in Azerbaijan with remote access trojans (RAT) capable of exfiltrating sensitive documents, keystrokes, passwords, and even images from the webcam. The targeted attacks employ Microsoft Word documents as droppers to deploy a previously unknown Python-based RAT dubbed "PoetRAT" due to




data

New Android Malware Steals Banking Passwords, Private Data and Keystrokes

A new type of mobile banking malware has been discovered abusing Android's accessibility features to exfiltrate sensitive data from financial applications, read user SMS messages, and hijack SMS-based two-factor authentication codes. Called "EventBot" by Cybereason researchers, the malware is capable of targeting over 200 different financial apps, including banking, money transfer services,




data

Critical SaltStack RCE Bug (CVSS Score 10) Affects Thousands of Data Centers

Two severe security flaws have been discovered in the open-source SaltStack Salt configuration framework that could allow an adversary to execute arbitrary code on remote servers deployed in data centers and cloud environments. The vulnerabilities were identified by F-Secure researchers earlier this March and disclosed on Thursday, a day after SaltStack released a patch (version 3000.2)




data

DigitalOcean Data Leak Incident Exposed Some of Its Customers Data

DigitalOcean, one of the biggest modern web hosting platforms, recently hit with a concerning data leak incident that exposed some of its customers' data to unknown and unauthorized third parties. Though the hosting company has not yet publicly released a statement, it did has started warning affected customers of the scope of the breach via an email. According to the breach notification





data

Using PHPMyadmin to delete old tables in your WordPress database

I had to use PHPMyadmin a few days ago to delete old tables in my WordPress Database. They were created by a plugin that I tried but decided not to use. Normally when you uninstall a plugin the developer deletes the tables in your database that they create. In this case this author didn’t. It […]




data

Multi-year datasets suggest projecting outcomes of people’s lives with AI isn't so simple

The machine learning techniques scientists use to predict outcomes from large datasets may fall short when it comes to projecting the outcomes of people’s lives, according to a large-scale mass collaboration led by researchers at Princeton.




data

Data: More students planning gap year

One in six high-school seniors report they definitely or most likely will alter their plans to enroll in college in the fall  -More



  • Teaching and Learning

data

Geographic Mobility in America: Evidence from Cell Phone Data -- by M. Keith Chen, Devin G. Pope

Traveling beyond the immediate surroundings of one’s residence can lead to greater exposure to new ideas and information, jobs, and greater transmission of disease. In this paper, we document the geographic mobility of individuals in the U.S., and how this mobility varies across U.S. cities, regions, and income classes. Using geolocation data for ~1.7 million smartphone users over a 10-month period, we compute different measures of mobility, including the total distance traveled, the median daily distance traveled, the maximum distance traveled from one’s home, and the number of unique haunts visited. We find large differences across cities and income groups. For example, people in New York travel 38% fewer total kilometers and visit 14% fewer block-sized areas than people in Atlanta. And, individuals in the bottom income quartile travel 12% less overall and visit 13% fewer total locations than the top income quartile.




data

US data to underscore divide between market and economy

A week packed with US economic data is likely to provide investors with more evidence of the extent to which the coronavirus pandemic has hit growth, sharpening the debate on whether a rebound in stocks has been justified amid an unprecedented slowdown.




data

Repeat Signage V4.0.6 - New database driven templates

Our Corporate edition now supports tying your database to a fully customisable template for automatic display of database information.




data

An agency hid Tesla crash data for nearly two years. Is that any way to build trust in driverless cars?

It was an extraordinary vote of confidence for autonomous driving by the nation's top vehicle safety agency.




data

Your Tesla could explain why it crashed. But good luck getting its Autopilot data

Tesla's Autopilot and other driver-assist systems might enhance safety, but manufacturers can keep the data under wraps.




data

House prices: Is UK property market about to crash? Latest data shows 'volatility'



IT WAS the inevitability that we were merely waiting to have confirmed. Latest data released this morning by mortgage lender Halifax indeed confirms that house prices cooled in April, as one would expect given the economic impacts of the current health crisis.




data

Tech firm with suspended contracts had outside data deal

A company which had contracts with Utah suspended over its founders past associations with white supremacists had an outside data deal, per reports.

       




data

Have roundabouts made Carmel drivers safer? The data suggests 'no'

Since 1998, the city of Carmel has spent more than $250 million to build 126 roundabouts in the city. But data doesn't prove safety claims.

       




data

Eli Lilly CEO: As Indiana reopens, let's proceed with caution and data

As we begin to reopen, we owe it to those we've lost to proceed gradually, making decisions based on what data shows about the virus' spread.

       





data

A hit-and-run scooter crash nearly killed him. Now he’s fighting for the data that could reveal the rider’s identity.

A Chicago cyclist was injured by an electric scooter rider who fled the scene. Now he's gone to court to get the city's scooter companies to turn over personal information about their riders and their history.




data

oscon: RT @OReillyMedia #Video Deal/Week: Data and Databases at #OSCON 2012 - $49.99 (Save 50%) Use code VDWK http://t.co/BnDD750NQv

oscon: RT @OReillyMedia #Video Deal/Week: Data and Databases at #OSCON 2012 - $49.99 (Save 50%) Use code VDWK http://t.co/BnDD750NQv




data

strataconf: Today's the last day to get best price discounts on #StrataRx Conf. Register by 11:59pmET http://t.co/cy4SudVIHZ #healthdata

strataconf: Today's the last day to get best price discounts on #StrataRx Conf. Register by 11:59pmET http://t.co/cy4SudVIHZ #healthdata




data

strataconf: A roundup from the data journalism beat http://t.co/y8RVUwHO4G Global open data, scholarships, mapping a civil war & more #strataconf

strataconf: A roundup from the data journalism beat http://t.co/y8RVUwHO4G Global open data, scholarships, mapping a civil war & more #strataconf




data

strataconf: Get Practical Strategies & Tactics for Moving to Big Data http://t.co/qn4gKSyBvw Jun11 Webcast - Best of #Strataconf + Hadoop World 2012

strataconf: Get Practical Strategies & Tactics for Moving to Big Data http://t.co/qn4gKSyBvw Jun11 Webcast - Best of #Strataconf + Hadoop World 2012




data

strataconf: Can data rescue the forest elephant? Yes, with your help. http://t.co/DZBXKRdUcA Read about Elephant Listening Project & send us your ideas

strataconf: Can data rescue the forest elephant? Yes, with your help. http://t.co/DZBXKRdUcA Read about Elephant Listening Project & send us your ideas




data

strataconf: Innovative ways journalists are using data to tell stories http://t.co/y8RVUwHO4G Global open data, scholarships, mapping a civil war & more

strataconf: Innovative ways journalists are using data to tell stories http://t.co/y8RVUwHO4G Global open data, scholarships, mapping a civil war & more




data

strataconf: Building Big Data applications now easier http://t.co/jaATalPL4P Hadoop analytic engines simplify creation of low-cost, scalable apps

strataconf: Building Big Data applications now easier http://t.co/jaATalPL4P Hadoop analytic engines simplify creation of low-cost, scalable apps




data

strataconf: TUE June 11 Best of Strata Webcast: Practical Strategies & Tactics for Moving to Big Data http://t.co/qn4gKSyBvw from #Strataconf + HW2012

strataconf: TUE June 11 Best of Strata Webcast: Practical Strategies & Tactics for Moving to Big Data http://t.co/qn4gKSyBvw from #Strataconf + HW2012




data

strataconf: Humans as nodes, pills & electronic tattoo password authenticators & hiding data in temporal cloaks http://t.co/vRgkRtTTKe #strataconf

strataconf: Humans as nodes, pills & electronic tattoo password authenticators & hiding data in temporal cloaks http://t.co/vRgkRtTTKe #strataconf




data

strataconf: A detailed agenda for #StrataRx 2013 is now posted: workshops, sessions, speakers + more http://t.co/RtaRpQroaN #healthdata

strataconf: A detailed agenda for #StrataRx 2013 is now posted: workshops, sessions, speakers + more http://t.co/RtaRpQroaN #healthdata




data

strataconf: Big data vs big reality http://t.co/D751jk0ntb Data itself has no quality. It’s what you do with it that counts

strataconf: Big data vs big reality http://t.co/D751jk0ntb Data itself has no quality. It’s what you do with it that counts




data

strataconf: Starts in 1 hour: Best of #Strataconf Webcast - 'Practical Strategies & Tactics for Moving to Big Data'. Watch at http://t.co/qn4gKSyBvw

strataconf: Starts in 1 hour: Best of #Strataconf Webcast - 'Practical Strategies & Tactics for Moving to Big Data'. Watch at http://t.co/qn4gKSyBvw




data

strataconf: RT @synergicpartner: We are pleased to announce that we will sponsor next #strataconf in London!!! @strataconf @synergicpartner #BigData ht…

strataconf: RT @synergicpartner: We are pleased to announce that we will sponsor next #strataconf in London!!! @strataconf @synergicpartner #BigData ht…




data

strataconf: As infrastructure gets simpler, interesting big data apps can emerge on BDAS, @Cloudera & other Hadoop distributions http://t.co/jaATalPL4P

strataconf: As infrastructure gets simpler, interesting big data apps can emerge on BDAS, @Cloudera & other Hadoop distributions http://t.co/jaATalPL4P




data

strataconf: Ways to put the patient first when collecting health data http://t.co/iACckzJjAW @praxagora #stratarx #healthit

strataconf: Ways to put the patient first when collecting health data http://t.co/iACckzJjAW @praxagora #stratarx #healthit




data

strataconf: The Future Is Graph Databases http://t.co/BVxOZwtoKS A Conversation with @EmilEifrem, founder of @Neo4J #strataconf

strataconf: The Future Is Graph Databases http://t.co/BVxOZwtoKS A Conversation with @EmilEifrem, founder of @Neo4J #strataconf




data

Practical Statistics for Data Scientists

Statistical methods are a key part of data science, yet few data scientists have formal statistical training. Courses and books on basic statistics rarely cover the topic from a data science perspective. The second edition of this popular guide adds comprehensive examples in Python, provides practical guidance on applying statistical methods to data science, tells you how to avoid their misuse, and gives you advice on what’s important and what’s not.




data

Data Science on AWS

If you use data to make critical business decisions, this book is for you. Whether you’re a data analyst, research scientist, data engineer, ML engineer, data scientist, application developer, or systems developer, this guide helps you broaden your understanding of the modern data science stack, create your own machine learning pipelines, and deploy them to applications at production scale.




data

Fin24.com | MTN slashes data prices

MTN on Friday announced a drop in the price of monthly data bundles and customers will now pay R99 for 1GB, 33% lower than previously.




data

Fin24.com | Icasa wants companies to lower data cost during coronavirus outbreak

The communications regulator is asking telecom companies to consider lowering the cost of data in a bid to ensure productivity during the period the coronavirus outbreak.




data

Fin24.com | Datatec sees increased demand for its remote access computing

Datatec tells shareholders that the rapidly spreading coronavirus outbreak has reached every region where the group operates.




data

How to Ensure Your Data is Providing Trustworthy Insights

For building owners and managers, data is the fuel behind their smart building operations. Leveraging the surplus of data that is readily available to them, owners and managers are making informed decisions for their facility that can create long-term performance enhancements and help them achieve goals such as improved efficiency and occupant comfort. Here is […]

The post How to Ensure Your Data is Providing Trustworthy Insights appeared first on ReadWrite.




data

Google’s May 2020 core update was big and broad, search data tools show

This update was an “absolute monster” said Mordy Oberstein from RankRanger.

Please visit Search Engine Land for the full article.




data

Proposed MLS Policy Would Ensure Brokers Receive Their Own Listing Data

The move would close a loophole on an otherwise widespread practice.




data

Predictions 2020: Facebook Caves, Google Zags, Netflix Sells Out, and Data Policy Gets Sexy

A new year brings another run at my annual predictions: For 17 years now, I’ve taken a few hours to imagine what might happen over the course of the coming twelve months. And my goodness did I swing for the fences last year — and I pretty much whiffed. Batting .300 is great in the majors, but it … Continue reading "Predictions 2020: Facebook Caves, Google Zags, Netflix Sells Out, and Data Policy Gets Sexy"




data

Four Providers’ Houston Data Centers Online, but Access Roads Flooded