Researchers from Microsoft explained their machine learning model in a paper on preprint repository arXiv.

The model uses VIsual VOcabulary pre-training (VIVO) which leverages large amounts of paired image-tag data to learn a visual vocabulary.

A second dataset of properly captioned images is then used to help teach the AI how to best describe the pictures.

“Ideally, everyone would include alt text for all images in documents, on the web, in social media – as this enables people who are blind to access the content and participate in the conversation. But, alas, people don’t,” said Saqib Shaikh, a software engineering manager with Microsoft’s AI platform group.

Overall, the researchers expect the AI to deliver twice the performance of Microsoft’s existing captioning system.

In order to benchmark the performance of their new AI, the researchers entered it into the ‘nocaps’ challenge. As of writing, Microsoft’s AI now ranks first on its leaderboard.

“The nocaps challenge is really how are you able to describe those novel objects that you haven’t seen in your training data?” commented Lijuan Wang, a principal research manager in Microsoft’s research lab.

Developers wanting to get started with building apps using Microsoft’s auto-captioning AI can already do so as it’s available in Azure Cognitive Services’ Computer Vision package.

Microsoft’s impressive SeeingAI application – which uses computer vision to describe an individual’s surroundings for people suffering from vision loss – will be updated with features using the new AI.

“Image captioning is one of the core computer vision capabilities that can enable a broad range of services,” said Xuedong Huang, Microsoft CTO of Azure AI Cognitive Services.

“We’re taking this AI breakthrough to Azure as a platform to serve a broader set of customers,” Huang continued. “It is not just a breakthrough on the research; the time it took to turn that breakthrough into production on Azure is also a breakthrough.”

The improved auto-captioning feature is also expected to be available in Outlook, Word, and PowerPoint later this year.

(Photo by K8 on Unsplash)

The post Microsoft’s new AI auto-captions images for the visually impaired appeared first on AI News.

GPT-3 has been the talk of the AI town in recent months. OpenAI’s innovation can help to create convincing articles and the company once deemed it too dangerous to release in a world where misinformation and fake news is already problematic.

OpenAI never made GPT-3 publicly available but instead provided access to a limited number of trusted researchers.

Microsoft announced today that it now has the exclusive rights to leverage GPT-3’s “technical innovations to develop and deliver advanced AI solutions for our customers, as well as create new solutions that harness the amazing power of advanced natural language generation.”

In other words, Microsoft will be able to deploy GPT-3 capabilities in products such as Office, Windows, and Teams.

Kevin Scott, Chief Technology Officer at Microsoft, wrote in a blog post:

“GPT-3 is the largest and most advanced language model in the world, clocking in at 175 billion parameters, and is trained on Azure’s AI supercomputer.

Today, I’m very excited to announce that Microsoft is teaming up with OpenAI to exclusively license GPT-3, allowing us to leverage its technical innovations to develop and deliver advanced AI solutions for our customers, as well as create new solutions that harness the amazing power of advanced natural language generation.”

There has been some debate over the impact GPT-3 will have on society. Some believe it’s dangerous, while others don’t think it poses a threat (at least in its current form.)

A Guardian article earlier this month with the headline ‘A robot wrote this entire article. Are you scared yet, human?’ really kicked off the debate.

The article used GPT-3 to generate its content but was accused of being misleading as it required substantial human intervention.

For the Guardian’s article, a human first wrote 50 words. GPT-3 then created eight drafts from the contributed text. A human then went through each of the eight drafts and picked the best parts. Finally, a human went on to edit the text to make it coherent before publishing it.

AI expert Jarno Duursma called GPT-3 “essentially a super-advanced auto-complete system.”

A blossoming relationship

Last year, Microsoft invested $1 billion in OpenAI to help speed up the development of Artificial General Intelligence (AGI) – which overcomes today’s AI limitations.

Current AIs are designed for specific tasks and require some human input. AGIs will be able to think like a human and handle multiple tasks, similar to how JARVIS and HAL are portrayed in films.

Microsoft’s bumper investment in OpenAI secured its place as the exclusive provider of cloud computing services for the AI giant. Together, the pair have committed to building new Azure AI supercomputing technologies.

Satya Nadella, CEO of Microsoft, said last year of the company’s OpenAI investment:

“AI is one of the most transformative technologies of our time and has the potential to help solve many of our world’s most pressing challenges.

By bringing together OpenAI’s breakthrough technology with new Azure AI supercomputing technologies, our ambition is to democratise AI — while always keeping AI safety front and centre — so everyone can benefit.”

The exclusive rights to use GPT-3 is the first major win for Microsoft from its OpenAI investment, but it’s unlikely to be the last.

Back in May, Microsoft signed another deal with OpenAI to build an Azure-hosted supercomputer for testing large-scale models.

Microsoft and OpenAI’s supercomputer will deliver eye-watering amounts of power from its 285,000 CPU cores and 10,000 GPUs. Such power will be required for achieving the holy grail of AGI.

“We’ve learned more and more about what we need and the different limits of all the components that make up a supercomputer,” said Sam Altman, CEO of OpenAI earlier this year. “Microsoft was able to build it.”

The blossoming relationship between Microsoft and OpenAI looks only set to get stronger in the coming years.

The post Microsoft is granted exclusive rights to use OpenAI’s GPT-3 appeared first on AI News.

The research, titled AI Skills in the UK, shines a spotlight on some concerning issues.

For its UK report, Microsoft used data from a global AI skills study featuring more than 12,000 people in 20 countries to see how the UK is doing in comparison to the rest of the world.

Most notably, compared to the rest of the world, the UK is seeing a higher failure rate for AI projects. 29 percent of AI ventures launched by UK businesses have generated no commercial value compared to the 19 percent average elsewhere in the world.

35 percent of British business leaders foresee an AI skills gap within two years, while 28 percent believe there already is one (above the global average of 24%).

However, it seems UK businesses aren’t helping to prepare employees with the skills they need. Just 17 percent of British employees have been part of AI reskilling efforts (compared to the global figure of 38 percent.)

Agata Nowakowska, AVP EMEA at Skillsoft, said:

“UK employers will have to address the growing digital skills gap within the workforce to ensure their business is able to fully leverage every digital transformation investment that’s made. With technologies like AI and cloud becoming as commonplace as word processing or email in the workplace, firms will need to ensure employees can use such tools and aren’t apprehensive about using them.

Organisations will need to think holistically about managing reskilling, upskilling and job transitioning. As the war for talent intensifies, employee development and talent pooling will become increasingly vital to building a modern workforce that’s adaptable and flexible. Addressing and easing workplace role transitions will require new training models and approaches that include on-the-job training and opportunities that support and signpost workers to opportunities to upgrade their skills.” 

Currently, a mere 32 percent of British employees feel their workplace is doing enough to prepare them for an AI-enabled future (compared to the global average of 42%)

“The most successful organisations will be the ones that transform both technically and culturally, equipping their people with the skills and knowledge to become the best competitive asset they have,” comments Simon Lambert, Chief Learning Officer for Microsoft UK.

“Human ingenuity is what will make the difference – AI technology alone will not be enough.”

AI brain drain

It’s well-documented that the UK suffers from a “brain drain” problem. The country’s renowned universities – like Oxford and Cambridge – produce globally desirable AI talent, but they’re often swooped up by Silicon Valley giants who are willing to pay much higher salaries than many British firms.

In one example, a senior professor from Imperial College London couldn’t understand why one of her students was not turning up to any classes. Most people wouldn’t pay £9,250 per year in tuition fees and not turn up. The professor called her student to find out why he’d completed three years but wasn’t turning up for his final year. She found that he was offered a six-figure salary at Apple. 

This problem also applies to teachers who are needed to pass their knowledge onto the future generations. Many are lured away from academia to work on groundbreaking projects with almost endless resources, less administrative duties, and be paid handsomely for it too.

Some companies, Microsoft included, have taken measures to address the brain drain problem. After all, a lack of AI talent harms the entire industry.

Dr Chris Bishop, Director of Microsoft’s Research Lab in Cambridge, said:

“One thing we’ve seen over the past few years is: because there are so many opportunities for people with skills in machine learning, particularly in industry, we’ve seen a lot of outflux of top academic talent to industry.

This concerns us because it’s those top academic professors and researchers who are responsible not just for doing research, but also for nurturing the next generation of talent in this field.”

Since 2018, Microsoft has funded a program for training the next generation of data scientists and machine-learning engineers called the Microsoft Research-Cambridge University Machine Learning Initiative.

Microsoft partners with universities to ensure it doesn’t steal talent, allows employees to continue roles in teaching, funds some related PhD scholarships, sends researchers to co-supervise students in universities, and offers paid internships to work alongside teams at Microsoft on projects.

You can find the full AI Skills in the UK report here.

(Photo by William Warby on Unsplash)

The post Microsoft: The UK must increase its AI skills, or risk falling behind appeared first on AI News.

In late May, Microsoft decided to fire many of its human editors for MSN News and replace them with an AI.

Earlier this week, a news story appeared about Little Mix band member Jade Thirlwall’s experience facing racism. The story appears innocent enough until you realise Microsoft’s AI confused two of the mixed-race band members. The error was quickly pointed out by Thirlwall.

In an Instagram story, Thirlwall wrote: “@MSN If you’re going to copy and paste articles from other accurate media outlets, you might want to make sure you’re using an image of the correct mixed race member of the group.”

She added: “This shit happens to @leighannepinnock and I ALL THE TIME that it’s become a running joke … It offends me that you couldn’t differentiate the two women of colour out of four members of a group … DO BETTER!”

Microsoft’s human editors were reportedly told to be aware the AI may subsequently publish stories on its own racist error and to manually remove them.

Staff at MSN have also been told to await the publication of this Guardian article and try to manually delete it from the website, because there is a high risk the Microsoft robot editor taking their jobs will decide it is of interest to MSN readers. https://t.co/KkKDZqpHWu

— Jim Waterson (@jimwaterson) June 9, 2020

The Microsoft News app ended up being flooded with stories about the incident. It’s clear that the remaining human editors couldn’t move fast enough against their automated counterpart.

Final update on the thread of news dystopia: Microsoft’s artificial intelligence news app is now swamped with stories selected by the news robot about the news robot backfiring. pic.twitter.com/X0LwfVxw8e

— Jim Waterson (@jimwaterson) June 9, 2020

According to Waterson, the recently-sacked human staff from MSN have been told to stop reporting to him what the AI is doing.

This isn’t the first time an AI-powered solution from Microsoft has come under fire for racism.

An infamous Twitter chatbot developed by Microsoft called Tay ended up spouting racist and misogynistic vitriol back in 2016. The chatbot obviously wasn’t designed to be such an unsavoury character but Microsoft, for some reason, thought it would be a good idea to allow internet denizens to train it.

One of the most pressing concerns in this increasingly draconian world we live in is that of mass surveillance and facial recognition. While IBM announced this week it wants nothing more to do with the technology, Microsoft remains a key player.

An experiment by the Algorithmic Justice League last year found serious disparities between the performance of facial recognition algorithms based on gender and skin colour. 

Microsoft’s algorithm actually performed the best of those tested and managed a 100 percent accuracy when detecting lighter-skinned males. However, the algorithm was just 79.2 percent accurate when used on darker-skinned females.

If that version of Microsoft’s facial recognition system was used for surveillance – almost two in every ten females with darker skin risks being falsely flagged. In busy areas, that could mean hundreds if not thousands of people facing automated profiling each day.

While ideally algorithms wouldn’t have any biases or issues, all of the incidents show exactly why many humans should almost always be involved in final decisions. That way, when things go wrong, at least there’s accountability to a specific person rather than just blaming an AI error.

(Image Credit: Little Mix by vagueonthehow under CC BY 2.0 license)

The post Microsoft’s AI editor publishes stories about its own racist error appeared first on AI News.

The supercomputer will deliver eye-watering amounts of power from its 285,000 CPU cores and 10,000 GPUs (yes, it can probably even run Crysis.)

OpenAI is a non-profit that was founded by one Elon Musk to promote the ethical development of artificial intelligence technologies. Musk, however, departed OpenAI following disagreements over the company’s direction.

Back in February, Musk responded to an MIT Technology Review profile of OpenAI saying that it “should be more open,” and that all organisations “developing advanced AI should be regulated, including Tesla.”

Microsoft invested $1 billion in OpenAI last year and it seems we’re just beginning to see the fruits of that relationship. While most AIs today focus on doing single tasks well, the next wave of research is focusing on performing multiple at once.

“The exciting thing about these models is the breadth of things they’re going to enable,” said Microsoft Chief Technical Officer Kevin Scott.

“This is about being able to do a hundred exciting things in natural language processing at once and a hundred exciting things in computer vision, and when you start to see combinations of these perceptual domains, you’re going to have new applications that are hard to even imagine right now.”

So-called Artificial General Intelligence (AGI) is the ultimate goal for AI research; the point when a machine can understand or learn any task just like the human brain.

“The creation of AGI will be the most important technological development in human history, with the potential to shape the trajectory of humanity,” said Sam Altman, CEO, OpenAI. “Our mission is to ensure that AGI technology benefits all of humanity, and we’re working with Microsoft to build the supercomputing foundation on which we’ll build AGI.”

“We believe it’s crucial that AGI is deployed safely and securely and that its economic benefits are widely distributed. We are excited about how deeply Microsoft shares this vision.”

AGI will, of course, require tremendous amounts of processing power.

Microsoft and OpenAI claim their new supercomputer would rank in the top five but do not give any specific power measurements. To rank in the top five, a supercomputer would currently require more than 23,000 teraflops of performance. The current leader, the IBM Summit, reaches over 148,000 teraflops.

“As we’ve learned more and more about what we need and the different limits of all the components that make up a supercomputer, we were really able to say, ‘If we could design our dream system, what would it look like?’” said Altman. “And then Microsoft was able to build it.”

Unfortunately, for now at least, the supercomputer is built exclusively for OpenAI.

The post Microsoft partners with OpenAI to build Azure supercomputer appeared first on AI News.

The new video courses assume the developer already has a basic standard of Python skills. If you don’t, I’m afraid you’ll need to brush up on those first. Fortunately, Microsoft released a 44-part “Python for Beginners” series last autumn (or “fall” for our American friends.)

For those with the Python skills, or if you’ve just consumed all 44-parts of Microsoft’s course in record time, the new courses are around three hours each. 

The first course, More Python for Beginners, features 20 videos and covers areas such as lambdas, inheritance, and asynchronous operations.

The second course, Even More Python for Beginners: Data Tools, consists of 31 videos and really dives into using Python for machine learning and data science. Students are taught how to use popular Python libraries for the aforementioned topics; along with using the Jupyter Notebooks browser-based development environment.

Each of the courses are still led by Christopher Harrison, senior program manager at Microsoft, and Susan Ibach, business development manager from Microsoft AI Gaming. 

“While we’re not going to get into conversations about choosing algorithms or building models, we are going to introduce what you’ll use when you begin the journey. We’ll highlight Jupyter Notebooks, the favorite tool of data scientists,” Harrison and Ibach wrote in a blog. 

As of writing, the first part in Microsoft’s Python course series has been viewed over 1.75 million times.

The course’s popularity is of little surprise given the huge interest in Python as AI talent becomes more in-demand; with six-figure salaries not unheard of. In last year’s GitHub Octoverse report, Python overtook Java to become the second most popular language on the world’s largest repository host.

The post Microsoft releases two Python video courses which help aspiring AI developers appeared first on AI News.

In a blog post today, Microsoft chief data analytics officer John Kahan detailed the new initiative which aims to advance the health of people and communities around the world.

Kahan notes how, on the whole, people have never been healthier or safer. He particularly highlights the steep decline in child and maternal mortality rates.

However, this progress has not been shared equally around the world. Some areas are still underserved with a lack of access to even basic healthcare.

The initiative Microsoft is launch, AI for Health, is a five-year program which focuses on three key areas:

• Quest for discovery. Accelerating medical research to advance prevention, diagnoses and treatment of diseases
• Global health insights. Increasing our shared understanding of mortality and longevity to protect against global health crises
• Health equity. Reducing health inequity and improving access to care for underserved populations

The money committed by Microsoft will help fund nonprofits, researchers, and others, who are working to improve healthcare around the world using AI. Partners in the program will have access to Microsoft’s data scientists and AI and cloud tools.

Microsoft is expanding its cooperation with BRAC, PATH, and St. Jude Children’s Research Hospital, to help speed up their work in tackling things like childhood cancer, tuberculosis, and maternal mortality.

Interested in hearing industry leaders discuss subjects like this? , , , AI &

The post Microsoft details $40 million ‘AI for Health’ initiative appeared first on AI News.

Most sci-fi fans will think of Terminator when they hear of killer robots. In the classic film series, a rogue military AI called Skynet gained self-awareness after spreading to millions of servers around the world. Concluding that humans would attempt to shut it down, Skynet sought to exterminate all of mankind in the interest of self-preservation.

While it was once just a popcorn flick, Terminator now offers a dire warning of what could be if precautions are not taken.

As with most technologies, AI will find itself increasingly used for military applications. The ultimate goal for general artificial intelligence is to self-learn. Combine both, and Skynet no longer seems the wild dramatisation that it once did.

Speaking to The Telegraph, Smith seems to agree. Smith points towards developments in the US, China, UK, Russia, Isreal, South Korea, and others, who are all developing autonomous weapon systems.

Wars could one day be fought on battlefields entirely with robots, a scenario that has many pros and cons. On the one hand, it reduces the risk to human troops. On the other, it makes declaring war easier and runs the risk of machines going awry.

Many technologists have likened the race to militarise AI to the nuclear arms race. In a pursuit to be the first and best, dangerous risks may be taken.

There’s still no clear responsible entity for death or injuries caused by an autonomous machine – the manufacturer, developer, or an overseer. This has also been a subject of much debate in regards to how insurance will work with driverless cars.

With military applications, many technologists have called for AI to never make a combat decision – especially one that would result in fatalities – on its own. While AI can make recommendations, a final decision must be made by a human.

Preventing unimaginable devastation

The story of Russian lieutenant colonel Stanislav Petrov in 1983 offers a warning of how a machine without human oversight may cause unimaginable devastation.

Petrov’s computers reported that an intercontinental missile had been launched by the US towards the Soviet Union. The Soviet Union’s strategy was an immediate and compulsory nuclear counter-attack against the US in such a scenario. Petrov used his instinct that the computer was incorrect and decided against launching a nuclear missile, and he was right. 

Had the decision in 1983 whether to deploy a nuclear missile been made solely on the computer, one would have been launched and met with retaliatory launches from the US and its allies.

Smith wants to see a new digital Geneva Convention in order to bring world powers together in agreement over acceptable norms when it comes to AI. “The safety of civilians is at risk today. We need more urgent action, and we need it in the form of a digital Geneva Convention, rules that will protect civilians and soldiers.” 

Many companies – including thousands of Google employees, following backlash over a Pentagon contract to develop AI tech for drones – have pledged not to develop AI technologies for harmful use.

Smith has launched a new book called Tools and Weapons. At the launch, Smith also called for stricter rules over the use of facial recognition technology. “There needs to be a new law in this space, we need regulation in the world of facial recognition in order to protect against potential abuse.”

Last month, a report from Dutch NGO PAX said leading tech firms are putting the world ‘at risk’ of killer AI. Microsoft, along with Amazon, was ranked among the highest risk. Microsoft itself warned investors back in February that its AI offerings could damage the company’s reputation. 

“Why are companies like Microsoft and Amazon not denying that they’re currently developing these highly controversial weapons, which could decide to kill people without direct human involvement?” said Frank Slijper, lead author of PAX’s report.

A global campaign simply titled Campaign To Stop Killer Robots now includes 113 NGOs across 57 countries and has doubled in size over the past year.

Interested in hearing industry leaders discuss subjects like this? , , , AI &

The post Microsoft chief Brad Smith warns that killer robots are ‘unstoppable’ appeared first on AI News.

The kit is built on Qualcomm’s Vision Intelligence 300 Platform and can run AI models locally or in the cloud using Microsoft’s Azure ML and Azure IoT Edge platforms.

eInfochips manufactures the Vision AI Developer Kit which features both a camera and the software needed to develop intelligent computer vision apps.

The hardware runs Yocto Linux, uses a Qualcomm Snapdragon 603 chip, has 4GB of LDDR4X memory, and 64GB of storage. The camera is 8-megapixel, records in 4K, and captures audio using an array of four microphones.

In terms of connectivity, the Vision AI Developer Kit features WiFi (802.11b/g/n, 2.4GHz, 5GHz) and has an HDMI out, USB-C, Micro SD slot, and audio in/out ports.

An SDK combining Visual Studio Code, a module which can recognise in excess of 183 unique objects, prebuilt Azure IoT deployment configurations, Python modules, and a Vision AI Developer kit extension for Visual Studio is available on GitHub.

Microsoft claims vision models can be deployed in minutes ”regardless of your current machine learning skill level”.

In a blog post, Microsoft principal project manager Anne Yang wrote:

“Artificial intelligence workloads include megabytes of data and potentially billions of calculations. With advancements in hardware, it is now possible to run time-sensitive AI workloads on the edge while also sending outputs to the cloud for downstream applications.

AI scenarios processed on the edge can facilitate important business scenarios, such as verifying if every person on a construction site is wearing a hardhat, or detecting whether items are out-of-stock on a store shelf.”

According to Yang, the Snapdragon Neural Processing Engine — which features in Qualcomm’s Vision Intelligence 300 platform — powers on-device execution of containerised Azure services. This capability makes the Vision AI Developer Kit the first “fully accelerated” platform supported end-to-end by Azure.

The Vision AI Developer Kit is available now for $249 from Arrow Electronics.

The post Microsoft and Qualcomm debut their Vision AI Developer Kit appeared first on AI News.

PAX, a Dutch NGO, ranked 50 firms based on three criteria:

1. If technology they’re developing could be used for killer AI.
2. Their involvement with military projects.
3. If they’ve committed to not being involved with military applications in the future.

Microsoft and Amazon are named among the world’s ‘highest risk’ tech companies putting the world at risk, while Google leads the way among large tech companies implementing proper safeguards.

Google’s ranking among the safest tech companies may be of surprise to some given the company’s reputation for mass data collection. Mountain View was also caught up in an outcry regarding its controversial ‘Project Maven’ contract with the Pentagon.

Project Maven was a contract Google had with the Pentagon to supply AI technology for military drones. Several high-profile employees resigned over the contract, while over 4,000 Google staff signed a petition demanding their management cease the project and never again “build warfare technology.”

Following the Project Maven backlash, Google CEO Sundar Pichai promised in a blog post the company will not develop technologies or weapons that cause harm, or anything which can be used for surveillance violating “internationally accepted norms” or “widely accepted principles of international law and human rights”.

Pichai’s promise not to be involved with such contracts in the future appears to have satisfied PAX in their rankings. Google has since attempted to improve its public image around its AI developments with things such as the creation of a dedicated ethics panel, but that backfired and collapsed quickly after featuring a member of a right-wing think tank and a defense drone mogul.

“Why are companies like Microsoft and Amazon not denying that they’re currently developing these highly controversial weapons, which could decide to kill people without direct human involvement?” said Frank Slijper, lead author of the report published this week.

Microsoft, which ranks among the highest risk tech companies in PAX’s list, warned investors back in February that its AI offerings could damage the company’s reputation. 

In a quarterly report, Microsoft wrote:

“Some AI scenarios present ethical issues. If we enable or offer AI solutions that are controversial because of their impact on human rights, privacy, employment, or other social issues, we may experience brand or reputational harm.”

Some of Microsoft’s forays into the technology have already proven troublesome, such as chatbot ‘Tay’ which became a racist, sexist, generally-rather-unsavoury character after internet users took advantage of its machine-learning capabilities.

Microsoft and Amazon are both currently bidding for a $10 billion Pentagon contract to provide cloud infrastructure for the US military.

“Tech companies need to be aware that unless they take measures, their technology could contribute to the development of lethal autonomous weapons,” comments Daan Kayser, PAX project leader on autonomous weapons. “Setting up clear, publicly-available policies is an essential strategy to prevent this from happening.”

You can find PAX’s full risk assessment of the companies here (PDF).

The post Report: Companies like Amazon and Microsoft are ‘putting world at risk’ of killer AI appeared first on AI News.