Skip to main content

LinkedIn Open-Sources FeatureFu, A Toolkit For Building Machine Learning Models


LinkedIn today announced that it is open-sourcing an internal tool called FeatureFu. The FeatureFu toolkit is meant to make it easier for developers to build their machine learning models around statistical modeling and decision engines.
The idea here is to take LinkedIn’s knowledge around “feature engineering” and make it accessible to developers outside of the company. In machine learning, feature engineering is basically using your detailed knowledge of the phenomenon you are looking at and then using that to build machine learning models.
LinkedIn argues that most large-scale recommendation systems (think LinkedIn’s own tools for suggesting connections on its site) are managed by at least two teams: one that handles the offline modeling and one that takes care of the online feature-serving/model-scoring part of the system. This leads to a number of problems FeatureFu is trying to solve.
“Many large-scale recommendation systems are brittle and vulnerable. FeatureFu allows for creative and agile development on these systems so that shipping new features doesn’t take weeks or even months,” LinkedIn senior software engineer Bing Zhao told me.
A small change in how features are generated can create lots of work for the other team, for example, and also makes it hard to experiment with different feature/model techniques.
FeatureFu uses a small Java library called Expr that developers can use to transform and build upon an existing set of features. “Once deployed to an online feature generation framework, it eliminates any further need for code-change to ship models for a wide range of derived features,” as Zhao describes the advantages of this system.
So why did LinkedIn decide to open source this tool? “When we have a business need for software, we first look to see if there are pre-existing software projects in open source. If there isn’t then we create it ourselves,” Zhao told me. “As long as the software isn’t a business differentiator, then we often open source the project so that many can benefit.”
Zhao also noted that he hopes for FeatureFu to become widely adopted. “FeatureFu could become a common technique for many machine learning systems,” he said. “It enables feature engineering to be more agile, which is one of the keys to success for machine learning applications. So we wanted to share our work with the industry.”

Comments

Popular posts from this blog

Best Web Design Company in Pondicherry

#Technology    has two faces. We all feel it, but sometimes can’t find words to describe it.  #Ebooks    are the best example to show the 0-1 nature of emotions the  #technology  evokes. #itwhere    provide a  #Best     #solutions    to  #Growyourbusiness    feel free to drop a  #Mail    info@itwheretech.co.in www.itwheretech.co.in 

How ad-free subscriptions could solve Facebook

At the core of Facebook’s “well-being” problem is that its business is directly coupled with total time spent on its apps. The more hours you pass on the social network, the more ads you see and click, the more money it earns. That puts its plan to make using Facebook healthier at odds with its finances, restricting how far it’s willing to go to protect us from the harms of over use. The advertising-supported model comes with some big benefits, though. Facebook CEO Mark Zuckerberg has repeatedly said that “We will always keep Facebook a free service for everyone.” Ads lets Facebook remain free for those who don’t want to pay, and more importantly, for those around the world who couldn’t afford to. Ads pay for Facebook to keep the lights on, research and develop new technologies, and profit handsomely in a way that attracts top talent and further investment. More affluent users with more buying power in markets like the US, UK, and Canada command higher ad prices, effectively

Phoenix OS is (another) Android-as-a-desktop

Google Android may have been developed as a smartphone operating system (and later ported to tablets, TVs, watches, and other platforms), but over the past few years we’ve seen a number of attempts to turn it into a desktop operating system. One of the most successful has been  Remix OS , which gives Android a taskbar, start menu, and an excellent window management system. The Remix OS team has also generated a lot of buzz over the past year, and this week the operating system gained a lot of new alpha testers thanks to a  downloadable version of Remix OS  that you can run on many recent desktop or notebook computers. But Remix OS isn’t the only game in town.  Phoenix OS  is another Android-as-desktop operating system, and while it’s still pretty rough around the edges, there are a few features that could make it a better option for some testers. Some background I first discovered Phoenix OS from  a post in the Remix OS Google Group , although I’ve also found mentions of th

HOW TO CREATE UEFI BOOTABLE USB DRIVE TO INSTALL WINDOWS 8/8.1

Before comes  Windows 8 and Windows 8.1  you made the bootable iso  for  Windows 7. Boot from USB and start to setup the Windows 7.  Windows 8/8.1  don’t include the traditional BIOS . They use UEFI firmware  so you must follow another way to create a bootable USB . If you interest to read what is UEFI  you can find a small description  here  and more details here . UEFI  is more secure and faster than traditional  BIOS  but here comes the problem when you try to boot from an iso file to install  Windows 8/8.1 . I have spent lot of hours until found the right way to boot from a USB to install  Windows 8/8.1 . As an IT when  Windows 8 realeased I download the iso,  create the bootable usb to start the installation but never boot.I change USB , download again the iso , create multiple times the bootable usb but every time the same results. After lot of search I understand that must create a  UEFI bootable USB  to start the installation of   Windows 8/8.1 . Follow I will exp

Windows 10 for phones will be released on this Friday

Microsoft's head of the Windows Insider program, Gabe Aul, has announced today on Windows Weekly that they will release a  new build of Windows 10 for phones  on Friday at 10 AM PT. Windows 10 release date A few weeks back, the company announced a new list of supported devices for the next release but for the version that will be released on Friday, the Lumia Icon and Lumia 930 will not be supported. Gabe said during the announcement that it came down to the new UI being too small on these devices and as such, will not be included in this release. List of supported devices Lumia 1020 Lumia 1320 Lumia 1520 Lumia 520 Lumia 525 Lumia 526 Lumia 530 Lumia 530 Dual Sim Lumia 535 Lumia 620 Lumia 625 Lumia 630 Lumia 630 Dual Sim Lumia 635 Lumia 636 Lumia 638 Lumia 720 Lumia 730 Lumia 730 Dual SIM Lumia 735 Lumia 810 Lumia 820 Lumia 822 Lumia 830 Lumia 920 Lumia 925 Lumia 928 Lumia ICON Microsoft Lumia 430 Microsoft Lumia 435 Microsoft Lumia 435 Dual SIM Microsoft Lumia 435 Dual SIM D