When Apple Intelligence launched final 12 months, Apple promised us that its AI system would revolutionize how we use our units. Sadly, this previous 12 months has been far more middling than miraculous for Apple’s AI, with the platform failing to impress within the methods we had been hoping.
Which means there are plenty of methods Apple Intelligence could possibly be improved sooner or later. From improved automation to extra highly effective enhancing instruments and past, Apple’s AI basis opens up a world of prospects for bringing new sensible instruments to our Apple units. Listed here are 10 of the highest options we’d like to see within the subsequent model of Apple Intelligence.
Apple Intelligence 2.0: Quick enhancements
Picture era
Apple’s Picture Playground app is a enjoyable option to rapidly create quirky photos, nevertheless it’s nonetheless very restricted and rudimentary, particularly while you examine it to rival AI turbines equivalent to Secure Diffusion and GPT-4o Picture Era.
For starters, Apple wants to repair these persistent bugbears that appear to afflict virtually all AI turbines, issues like freakishly inaccurate palms and toes. However the enhancements must transcend that if Picture Playground is to achieve traction. We want much more management and adaptability over the pictures it whips up. Which means with the ability to import new era fashions and types, the flexibility to work with completely different facet ratios, modify the relative energy of every immediate, and extra.
It’s uncertain Apple will give us the flexibility to make phot-realistic photos, however there’s nonetheless so much Picture Playground can do to reinforce its generated artwork. For instance, the current OpenAI GPT-4o mannequin replace allowed customers to attract photos within the type of a Studio Ghibli Japanese animation movie. It was a viral sensation when it launched and precisely the form of factor Picture Playground must get some buzz.
Picture Playground gives rudimentary picture creation at greatest and must be significantly better.
Foundry
Picture enhancing
Talking of photos, Apple has introduced a couple of AI picture enhancing instruments to our units, but these may also be vastly improved. Within the first model of Apple Intelligence, we are able to take away distractions in photographs utilizing Apple Intelligence’s Clear Up instrument, for instance, however having the choice to add parts to your photos can be a enjoyable further. This might lengthen to refining current elements of your photos, equivalent to changing one kind of tree with one other in a panorama.
We’d additionally wish to get the facility to take away one thing from one picture and add it to a different. Or to summon Siri and use pure language to make edits. Think about how a lot trouble you possibly can save by merely saying, “Hey Siri, change this sky to a thunderous rainstorm.”
Foundry
Apple Intelligence 2.0: Foundational upgrades
Pure language search
One of many key concepts behind synthetic intelligence is that it’s going to simplify your day-to-day life. So why isn’t Apple Intelligence excellent at doing that? One key approach it may enhance is by including extra pure language capabilities.
This could possibly be actually efficient if it was added to issues like Highlight search or the Messages app. We should always be capable of open Highlight or Siri and ask, “Present me photographs I took between August 3 and 5.” Proper now, that doesn’t work. Highlight brings up photos, positive, however solely those who comprise the textual content you typed. With somewhat sprinkling of Apple Intelligence, these searches could possibly be far more helpful.
On-device search needs to be the muse of Apple intelligence.
Foundry
Apple LLM
One of many extra evident examples of Apple intelligence’s ineptitude is Siri’s integration with ChatGPT, which has the unlucky impact of straight evaluating Apple’s AI engine with a much more superior system. The comparability just isn’t precisely flattering to Apple’s toddler AI efforts.
What we actually want is for Apple to launch its personal LLM to compete with the likes of ChatGPT. For one factor, this might inject much more energy into Apple Intelligence’s engines and permit it to face toe-to-toe with the business’s greatest platforms. For one more, it will higher protect your privateness, since you possibly can keep within the Apple intelligence sphere with out venturing off into less-secure cloud-based alternate options. With an Apple LLM behind the wheel, there can be no want to modify to different AI instruments, which might preserve your workflow easy and uninterrupted.
Rumors have steered that this type of Apple-backed LLM is within the works, however we don’t know when it’d arrive. When it will definitely does drop, it could possibly be the jump-start Apple Intelligence must preserve tempo with its rivals.
Shortcuts
Apple’s Shortcuts app is likely one of the greatest instruments accessible in your iPhone, but I’d guess most individuals have by no means even opened it. A part of the issue is that Apple solely covers probably the most primary of duties, so that you’re by yourself if you wish to run extra advanced workflows.
This can be a place the place Apple Intelligence may step in to fill the hole. If AI was built-in into Shortcuts in order that you possibly can merely inform it what you wish to do, Shortcuts would immediately go from an underused utility to among the best iPhone options ever. As one of many major tenets of Apple intelligence, Shortcuts may counsel easy time-saving shortcuts all through the day like Siri ideas, and switch your iPhone into a real digital assistant.
Automated Shortcuts could possibly be a unbelievable option to set Apple Intelligence aside from its opponents.
Foundry
Well being and health
Well being and health monitoring has been considered one of Apple’s priorities lately, with the Apple Watch main the way in which. There’s plenty of well being knowledge stashed on our units, and there are many ways in which Apple’s AI may assist enhance well being and health with out compromising privateness. There are already rumors that Apple is engaged on an AI “coach” to interpret the information collected by your units and offer you a extra full image of your well being.
Such a platform may present itself in optimized exercises with Apple Intelligence crunching your health numbers after which constructing a customized exercise plan primarily based in your wants. Or specialised HIIT exercises, Pilates, weight coaching, or no matter it thinks it’s essential take your health to the subsequent degree.
Apple
Apple Intelligence 2.0: New options
Movies
Apple Intelligence is already getting used to edit photos on our iPhones, however what if it may apply its expertise to movies as effectively? The iPhone is already one of many prime video telephones round and AI may take it to the subsequent degree.
Maybe that will imply creating a listing of steered edits for any challenge you feed into it. Or the facility to take away distractions from movies in the identical approach you’ll be able to presently do with photos. Maybe even automated shade grading and audio mixing could possibly be added.
In fact, Apple shall be very cautious about treading on video enhancing – in spite of everything, it in all probability doesn’t wish to indicate it’s coming after the artistic industries after the Crush! advert fiasco – however a couple of helpful instruments for beginner editors to play with on their iPhones can be a welcome addition.
Notes
One of many ways in which Apple tried to reveal Apple Intelligence’s energy at WWDC 2024 was by way of transcribing audio within the Notes app. Sadly, that is neither a groundbreaking function nor one which’s even on par with rival AI platforms. It’d work effectively for easy voice memos, however something with multiple speaker rapidly turns into a jumbled mess.
There’s a fast approach Apple can repair this by instructing Apple Intelligence how you can routinely label audio system—in spite of everything, companies equivalent to Otter and the tiny unbiased MacWhisper app have been doing it for years.
Apple’s Notes app does an excellent job of transcribing with Apple Intelligence, nevertheless it’s not but sensible sufficient to tell apart between completely different audio system.
Apple
Maps
Through the years, Apple Maps has improved a lot that many iPhone customers now favor it over Google Maps. However as an alternative of Apple working a victory lap, Apple can use AI to reinforce Maps even additional.
In the meanwhile, you’ll be able to search Apple Maps for issues like eating places and retailers close to you. However I would like greater than that – I would like to have the ability to ask Apple Maps for “the perfect eating places close to me” and solely see the highest-rated ones. Or seek for eateries that serve meals with particular substances (that is presently very hit-and-miss). Or discover out the place the perfect viewpoints are in my metropolis (once more, that is unreliable). Apple Maps struggles with that proper now, however maybe Apple Intelligence would assist it get there.
Apple Intelligence may also assist with instructions. Siri is already fairly good at getting us from Level A to Level B, however as with a lot of Siri’s present options, it’s nonetheless disappointingly restricted to locations and addresses. Apple Intelligence may step in right here to make it extra highly effective. For instance, you possibly can ask Siri to “get me house utilizing probably the most eco-friendly route,” or “create a round strolling route within the countryside close to me.” Weaving extra AI into the combination may make these requests extra achievable for Apple’s digital assistant.
With somewhat Apple Intelligence, Maps could be a lot extra helpful.
Apple
House
Apple is closely rumored to be getting in on the sensible house act with a brand new HomePad hub system reportedly launching later this 12 months and early subsequent, and Apple Intelligence will virtually definitely tackle a central position in the way you work together with it. However
You may in the future use Apple Intelligence to investigate the related units in your sensible house to work out how you possibly can get monetary savings on electrical energy payments or scale back your carbon footprint. And with rumors swirling that Apple is engaged on a sequence of sensible house hubs, it’s doable that these capabilities will seem on the horizon sooner fairly than later.