<?xml version="1.0" encoding="UTF-8" ?><!-- generator=Zoho Sites --><rss version="2.0" xmlns:atom="http://www.w3.org/2005/Atom" xmlns:content="http://purl.org/rss/1.0/modules/content/"><channel><atom:link href="https://blog.icefire.ca/blogs/feed" rel="self" type="application/rss+xml"/><title>The PointFire Blog - The PointFire Blog for Multilingual SharePoint</title><description>The PointFire Blog - The PointFire Blog for Multilingual SharePoint</description><link>https://blog.icefire.ca/blogs</link><lastBuildDate>Sun, 13 Jul 2025 01:35:12 -0700</lastBuildDate><generator>http://zoho.com/sites/</generator><item><title><![CDATA[Big Changes to PnP PowerShell Scripts on September 8, 2024]]></title><link>https://blog.icefire.ca/blogs/post/big-changes-to-pnp-powershell-scripts-on-september-8-2024</link><description><![CDATA[The “PnP Management Shell” multi-tenant app registration will be deleted on September 8, 2024. This will affect every script that uses “Interactive” login to connect to SharePoint or to Microsoft Graph. PointFire is releasing its own script to solve the issue.]]></description><content:encoded><![CDATA[<div class="zpcontent-container blogpost-container "><div data-element-id="elm_lmk9h-FKQsO2ssDIaY0Qew" data-element-type="section" class="zpsection "><style type="text/css"></style><div class="zpcontainer-fluid zpcontainer"><div data-element-id="elm_FVJFHCJPTTqGvlEuqArt_A" data-element-type="row" class="zprow zprow-container zpalign-items- zpjustify-content- " data-equal-column=""><style type="text/css"></style><div data-element-id="elm_uqnvUw8KQlGcEIzHl6Hb1g" data-element-type="column" class="zpelem-col zpcol-12 zpcol-md-12 zpcol-sm-12 zpalign-self- "><style type="text/css"></style><div data-element-id="elm_DCeHYpFJQxiRcltFSTXL-w" data-element-type="text" class="zpelement zpelem-text "><style></style><div class="zptext zptext-align-center " data-editor="true"><div style="color:inherit;"><div style="color:inherit;"><p style="text-align:left;">On August 21, 2024 Vesa Juvonen, Principal Product Manager at Microsoft announced on behalf of the PnP PowerShell and CLI for Microsoft 365 groups that the <a href="https://pnp.github.io/blog/post/changes-pnp-management-shell-registration/" title="“PnP Management Shell” multi-tenant app registration would be deleted" target="_blank" rel="">“PnP Management Shell” multi-tenant app registration would be deleted</a> on September 8, 2024.&nbsp; This means that on that day, every script that uses the recommended “Interactive” login to connect to SharePoint or to Microsoft Graph will stop working.</p><p style="text-align:left;"><span><br></span></p><p style="text-align:left;"><span><br></span></p><p style="text-align:left;"><br></p><div style="color:inherit;"><p style="text-align:left;"><span style="font-size:16px;">This has a major impact on most people using PnP PowerShell scripts.&nbsp; The interactive login method is often the default method used, since it supports a lot of authentication methods including most forms of Multi-Factor Authentication (MFA), and it does not require tenant-specific parameters in the script.&nbsp; This allows PowerShell scripts to be signed for extra security.</span></p><p style="text-align:left;font-size:11pt;"><br></p><div style="color:inherit;"><p style="text-align:left;"><span style="font-size:16px;">Why is it called a multi-tenant app registration?&nbsp; This is because the maximum permissions that can be used by scripts that use Interactive connections to SharePoint are set in an AzureAD/EntraID app that is maintained by Microsoft Patterns and Practices (PnP) group in their tenant and is made available to be used by any tenant.&nbsp; The actual permissions are limited to the lower of those permissions and the permissions of the user that is logging in to SharePoint.</span></p><p style="text-align:left;font-size:11pt;"><br></p><div style="color:inherit;"><p style="text-align:left;"><span style="font-size:16px;">Until September 8, any tenant that wanted to use the “Interactive” login would have needed to invoke the “Register-PnPManagementShellAccess”&nbsp; command, once only, in order to have access to this “PnP Management Shell” app registration from within this tenant.&nbsp; Consenting to this could only be done by Azure AD administrators or Global administrators.&nbsp; After September 8, that consent within your tenant disappears because the original app registration itself will disappear, along with all its permissions.&nbsp; Anyone trying to use a script with Interactive login will fail, since the authentication relies on that app registration.</span></p></div>
</div></div></div></div></div></div><div data-element-id="elm_qtyk6Hfa8RXAHbr9SFZFhA" data-element-type="heading" class="zpelement zpelem-heading "><style></style><h3 class="zpheading zpheading-style-none zpheading-align-left " data-editor="true"><div><p><span style="font-family:&quot;Work Sans&quot;;font-size:16px;font-weight:700;color:rgb(11, 27, 45);">What is the alternative?</span></p></div></h3></div>
<div data-element-id="elm_DPtJ0adMKRQhEBwJJuNXYA" data-element-type="text" class="zpelement zpelem-text "><style></style><div class="zptext zptext-align-left " data-editor="true"><div style="color:inherit;"><div style="color:inherit;"><p><span style="font-size:16px;">The alternative, according to Microsoft, is to create your own single-tenant app registration in your own tenant’s EntraID, and use a different form of Interactive login.&nbsp; A command to create such a single-tenant app registration is being prepared by the PnP group, but at the time of writing three days before the deadline, it has not yet been released as part of PnP PowerShell</span></p><p style="font-size:11pt;"><br></p><p><a href="https://pnp.github.io/powershell/cmdlets/Register-PnPEntraIDAppForInteractiveLogin.html" title="Register-PnPEntraIDAppForInteractiveLogin" target="_blank" rel="">Register-PnPEntraIDAppForInteractiveLogin</a></p><p style="font-size:11pt;"><br></p><div style="color:inherit;"><p><span style="font-size:16px;">With time running out, PointFire is releasing its own script, which uses existing PnP commands to register an app called “PointFire PnP login” in your own tenant.&nbsp; It also stores the app ID in an environment variable named ENTRAID_CLIENT_ID that is used by all scripts that use the “Interactive” parameter, overriding the “PnP Management Shell” app registration that would normally be used.&nbsp; This way, existing scripts will not have to be modified.&nbsp; The new script is called “UserAuthentication.ps1” and will be included in all upcoming releases of PointFire 365 and PointFire Translator, but you can also request it directly from PointFire support.</span></p></div>
</div></div></div></div></div></div></div></div></div>]]></content:encoded><pubDate>Thu, 05 Sep 2024 10:37:17 -0400</pubDate></item><item><title><![CDATA[PointFire 365 will soon have a new look and new architecture]]></title><link>https://blog.icefire.ca/blogs/post/pointfire-365-will-soon-have-a-new-look-and-new-architecture</link><description><![CDATA[<img align="left" hspace="5" src="https://blog.icefire.ca/SharePoint-Addin-retirement-PointFire-blog.png"/>PointFire 365 is getting a new look. This is part of our plan to consolidate the two apps, classic and modern, into a single app. Translate any SharePoint page in seconds]]></description><content:encoded><![CDATA[<div class="zpcontent-container blogpost-container "><div data-element-id="elm_rLXUI3_bSM-iz9EZSj1Y7Q" data-element-type="section" class="zpsection "><style type="text/css"></style><div class="zpcontainer-fluid zpcontainer"><div data-element-id="elm_BZU8lkazSKezoEOwiLoSfg" data-element-type="row" class="zprow zprow-container zpalign-items- zpjustify-content- " data-equal-column=""><style type="text/css"></style><div data-element-id="elm_r7XSi_rDThKET2Uvg7O2oA" data-element-type="column" class="zpelem-col zpcol-12 zpcol-md-12 zpcol-sm-12 zpalign-self- "><style type="text/css"></style><div data-element-id="elm_7y81QwMnSQeC1XzQ4R8N6g" data-element-type="text" class="zpelement zpelem-text "><style></style><div class="zptext zptext-align-center " data-editor="true"><div style="color:inherit;"><p style="text-align:left;"><span style="font-size:16px;">You may have seen the message in the Message Center or in the App Catalog about the demise of SharePoint Add-ins in 2026.&nbsp; The upcoming version 3.0 of PointFire 365 will retire its own add-in at the same time as it brings in the new look.</span></p></div>
</div></div><div data-element-id="elm_WrAO8ZKSCo1edU1ujn0l0A" data-element-type="image" class="zpelement zpelem-image "><style> @media (min-width: 992px) { [data-element-id="elm_WrAO8ZKSCo1edU1ujn0l0A"] .zpimage-container figure img { width: 516px !important ; height: 90px !important ; } } @media (max-width: 991px) and (min-width: 768px) { [data-element-id="elm_WrAO8ZKSCo1edU1ujn0l0A"] .zpimage-container figure img { width:516px ; height:90px ; } } @media (max-width: 767px) { [data-element-id="elm_WrAO8ZKSCo1edU1ujn0l0A"] .zpimage-container figure img { width:516px ; height:90px ; } } [data-element-id="elm_WrAO8ZKSCo1edU1ujn0l0A"].zpelem-image { border-radius:1px; } </style><div data-caption-color="" data-size-tablet="" data-size-mobile="" data-align="left" data-tablet-image-separate="false" data-mobile-image-separate="false" class="zpimage-container zpimage-align-left zpimage-size-original zpimage-tablet-fallback-original zpimage-mobile-fallback-original hb-lightbox " data-lightbox-options="
                type:fullscreen,
                theme:dark"><figure role="none" class="zpimage-data-ref"><span class="zpimage-anchor" role="link" tabindex="0" aria-label="Open Lightbox" style="cursor:pointer;"><picture><img class="zpimage zpimage-style-none zpimage-space-none " src="https://blog.icefire.ca/SharePoint-Addins-PointFire-Blog.png" width="516" height="90" loading="lazy" size="original" data-lightbox="true"></picture></span></figure></div>
</div><div data-element-id="elm_UIFOL2ldd7Ir3jK9l53wtQ" data-element-type="image" class="zpelement zpelem-image "><style> @media (min-width: 992px) { [data-element-id="elm_UIFOL2ldd7Ir3jK9l53wtQ"] .zpimage-container figure img { width: 624px !important ; height: 326px !important ; } } @media (max-width: 991px) and (min-width: 768px) { [data-element-id="elm_UIFOL2ldd7Ir3jK9l53wtQ"] .zpimage-container figure img { width:624px ; height:326px ; } } @media (max-width: 767px) { [data-element-id="elm_UIFOL2ldd7Ir3jK9l53wtQ"] .zpimage-container figure img { width:624px ; height:326px ; } } [data-element-id="elm_UIFOL2ldd7Ir3jK9l53wtQ"].zpelem-image { border-radius:1px; } </style><div data-caption-color="" data-size-tablet="" data-size-mobile="" data-align="left" data-tablet-image-separate="false" data-mobile-image-separate="false" class="zpimage-container zpimage-align-left zpimage-size-original zpimage-tablet-fallback-original zpimage-mobile-fallback-original hb-lightbox " data-lightbox-options="
                type:fullscreen,
                theme:dark"><figure role="none" class="zpimage-data-ref"><span class="zpimage-anchor" role="link" tabindex="0" aria-label="Open Lightbox" style="cursor:pointer;"><picture><img class="zpimage zpimage-style-none zpimage-space-none " src="https://blog.icefire.ca/SharePoint-Addin-retirement-PointFire-blog.png" width="624" height="326" loading="lazy" size="original" data-lightbox="true"></picture></span></figure></div>
</div><div data-element-id="elm_9TaMD5QeMAt9jRhdy2RH6Q" data-element-type="text" class="zpelement zpelem-text "><style> [data-element-id="elm_9TaMD5QeMAt9jRhdy2RH6Q"].zpelem-text{ border-radius:1px; } </style><div class="zptext zptext-align-left " data-editor="true"><div style="color:inherit;"><div style="color:inherit;"><p><span style="font-size:16px;"><br></span></p><p><span style="font-size:16px;">Currently, PointFire 365 has two apps, both of which must be added to the site, named PointFire 365 and PointFire 365 Modern.&nbsp; In rough terms, PointFire 365 handles classic pages and pages in classic mode, while PointFire 365 handles modern pages.&nbsp; To use Microsoft’s terminology, “PointFire 365” is an add-in and “PointFire 365 modern” is an app.&nbsp; To avoid redundant code, the two apps (formally an app and an add-in) work hand in hand.</span></p><p><span style="font-size:16px;">In recent years, SPFx has added a lot of functionality that it was missing, to the point that it is now possible to put all the functionality into a single app.&nbsp; The project for doing this started long before the Microsoft announcement.</span></p><p style="font-size:11pt;"><br></p><p><span style="font-size:16px;">Another aspect of this new version is changing a lot of the popup and configuration page from full pages as they mostly are now, to panels on the right of the page, as you often see in modern apps and as you have doubtless seen while editing modern pages.&nbsp; As it happens, doing popups and pages is something that is difficult to do in a modern app and we were planning to do away with those anyway.&nbsp; Doing the architecture change and the UI change at the same time makes sense.</span></p><p style="font-size:11pt;"><br></p><p><span style="font-size:16px;">Version 2.7 of PointFire 365 is the last one where the classic app is mandatory.&nbsp; Version 3.0 will still have both the classic and the modern app, but the classic app will not have much functionality other than helping with the transition for users who are used to the current apps.&nbsp; This will happen this summer 2024, long before Microsoft’s 2026 deadline, so the impact on existing users will be minimal.</span></p></div>
</div></div></div><div data-element-id="elm_aw8Y_ZPlzVsDR6Ke3VjNFA" data-element-type="button" class="zpelement zpelem-button "><style> [data-element-id="elm_aw8Y_ZPlzVsDR6Ke3VjNFA"].zpelem-button{ border-radius:1px; } </style><div class="zpbutton-container zpbutton-align-left "><style type="text/css"> [data-element-id="elm_aw8Y_ZPlzVsDR6Ke3VjNFA"] .zpbutton.zpbutton-type-primary{ background-color:#3C98DE !important; } </style><a class="zpbutton-wrapper zpbutton zpbutton-type-primary zpbutton-size-md zpbutton-style-roundcorner " href="javascript:;"><span class="zpbutton-content">Download PointFire free trial</span></a></div>
</div></div></div></div></div></div>]]></content:encoded><pubDate>Wed, 10 Apr 2024 09:44:31 -0400</pubDate></item><item><title><![CDATA[Localize your SPFx solutions with PointFire Localizer]]></title><link>https://blog.icefire.ca/blogs/post/localize-your-spfx-solutions-with-pointfire-localizer1</link><description><![CDATA[<img align="left" hspace="5" src="https://blog.icefire.ca/PointFire-Localizer-Github-SPFx.png"/>Managing multilingual SharePoint Framework (SPFx) solutions? We just released a new open-source project on Github: PointFire Localizer. It's a GitHub action that helps you translate your localization files for your SPFx solutions.]]></description><content:encoded><![CDATA[<div class="zpcontent-container blogpost-container "><div data-element-id="elm_CKS1HxPaRzq2qfGHf45Iuw" data-element-type="section" class="zpsection "><style type="text/css"></style><div class="zpcontainer-fluid zpcontainer"><div data-element-id="elm_WmLYjZJARU6YPMa-rCDVMg" data-element-type="row" class="zprow zprow-container zpalign-items- zpjustify-content- " data-equal-column=""><style type="text/css"></style><div data-element-id="elm_ItIxS8-iT9GmtujFJtfw3A" data-element-type="column" class="zpelem-col zpcol-12 zpcol-md-12 zpcol-sm-12 zpalign-self- "><style type="text/css"> [data-element-id="elm_ItIxS8-iT9GmtujFJtfw3A"].zpelem-col{ border-radius:1px; } </style><div data-element-id="elm_5uZQgTfFS1e8j-O3TyoeMQ" data-element-type="text" class="zpelement zpelem-text "><style> [data-element-id="elm_5uZQgTfFS1e8j-O3TyoeMQ"].zpelem-text{ border-radius:1px; } </style><div class="zptext zptext-align-center " data-editor="true"><div style="color:inherit;"><div style="color:inherit;"><p style="text-align:left;"><span style="font-size:16px;">Managing multilingual SharePoint Framework (SPFx) solutions can get tricky as you need to ensure all translations are in place and take care of localization files from languages you need help understanding yourself. This was a problem we faced when developing our products.</span></p><p style="text-align:left;"><span style="font-size:16px;">&nbsp;</span></p><p style="text-align:left;"><span style="font-size:16px;">To be sure we always included all localization key/value pairs in our releases, we created some scripts that were only internally used.</span></p><p style="text-align:left;"><span style="font-size:16px;">&nbsp;</span></p><p style="text-align:left;"><span>We decided to make those scripts available to the community for free so you can also benefit from them. That is why we created a new open-source project called <a href="https://github.com/IceFireStudios/pointfire-localizer-action" rel="">PointFire Localizer</a>. This project is a GitHub Action that helps you translate your localization files for your SPFx solutions.</span></p><p style="text-align:left;"><span><br></span></p></div>
</div></div></div><div data-element-id="elm_q1_D6Xd7af1K2TdiStlVUg" data-element-type="image" class="zpelement zpelem-image "><style> @media (min-width: 992px) { [data-element-id="elm_q1_D6Xd7af1K2TdiStlVUg"] .zpimage-container figure img { width: 500px ; height: 215.71px ; } } @media (max-width: 991px) and (min-width: 768px) { [data-element-id="elm_q1_D6Xd7af1K2TdiStlVUg"] .zpimage-container figure img { width:500px ; height:215.71px ; } } @media (max-width: 767px) { [data-element-id="elm_q1_D6Xd7af1K2TdiStlVUg"] .zpimage-container figure img { width:500px ; height:215.71px ; } } [data-element-id="elm_q1_D6Xd7af1K2TdiStlVUg"].zpelem-image { border-radius:1px; } </style><div data-caption-color="" data-size-tablet="" data-size-mobile="" data-align="left" data-tablet-image-separate="false" data-mobile-image-separate="false" class="zpimage-container zpimage-align-left zpimage-size-medium zpimage-tablet-fallback-medium zpimage-mobile-fallback-medium hb-lightbox " data-lightbox-options="
                type:fullscreen,
                theme:dark"><figure role="none" class="zpimage-data-ref"><span class="zpimage-anchor" role="link" tabindex="0" aria-label="Open Lightbox" style="cursor:pointer;"><picture><img class="zpimage zpimage-style-none zpimage-space-none " src="https://blog.icefire.ca/PointFire-Localizer-Github-SPFx.png" width="500" height="215.71" loading="lazy" size="medium" data-lightbox="true"></picture></span></figure></div>
</div><div data-element-id="elm_90MfQuymlvrY4hZON5QPTg" data-element-type="text" class="zpelement zpelem-text "><style> [data-element-id="elm_90MfQuymlvrY4hZON5QPTg"].zpelem-text{ border-radius:1px; } </style><div class="zptext zptext-align-left " data-editor="true"><div style="color:inherit;"><div style="color:inherit;"><p><br></p><p>This article shows you how to use PointFire Localizer to localize your SPFx solutions.</p><div style="color:inherit;"><div style="text-align:center;"></div>
</div></div></div></div></div><div data-element-id="elm_RASCClQeakuOpvr9QWcegw" data-element-type="heading" class="zpelement zpelem-heading "><style> [data-element-id="elm_RASCClQeakuOpvr9QWcegw"].zpelem-heading { border-radius:1px; } </style><h2 class="zpheading zpheading-style-none zpheading-align-left " data-editor="true"><div><h2><span style="font-family:&quot;Work Sans&quot;;font-size:20px;font-weight:700;color:rgb(11, 27, 45);">Maintaining localization files</span></h2></div></h2></div>
<div data-element-id="elm_cvFEU8C9jlVE9sKQz5pbXg" data-element-type="text" class="zpelement zpelem-text "><style> [data-element-id="elm_cvFEU8C9jlVE9sKQz5pbXg"].zpelem-text{ border-radius:1px; } </style><div class="zptext zptext-align-left " data-editor="true"><div style="color:inherit;"><div style="color:inherit;"><p><span style="font-size:16px;">Every SPFx component has its own localization folder (`loc`) which contains a `en-us.js` and `myStrings.d.ts` file. There are ways to simplify this, like using a <a href="https://www.eliostruyf.com/simplify-localization-in-sharepoint-framework-projects/">single localization file</a> for all components, but eventually, you still must maintain all the key/value pairs for all languages.</span></p><p><span style="font-size:16px;"><br></span></p><div style="color:inherit;"><div style="text-align:center;"><span style="font-style:italic;">You can read more about simplifying localization in SPFx projects in the following&nbsp;article:&nbsp;</span></div>
<div style="text-align:center;"><div><span style="font-style:italic;"><a href="https://www.eliostruyf.com/simplify-localization-in-sharepoint-framework-projects/" rel="">Simplify localization in SharePoint Framework projects · Elio Struyf</a></span></div>
</div></div><p><span style="font-size:16px;">&nbsp;</span></p><p><span style="font-size:16px;">For instance, starting with a new SPFx project will get a `loc` folder with the `en-us.js` and `myStrings.d.ts` files. If you want to add French, you must create a `fr-fr.js` localization file and include the same key/value pairs as in the `en-us.js` file.</span></p><p><span style="font-size:16px;"><br></span></p><div style="color:inherit;"><div> ```javascript </div>
<div> define([], function() { </div><div> return { </div><div> &amp;quot;PropertyPaneDescription&amp;quot;: &amp;quot;Description&amp;quot;, </div>
<div> &amp;quot;BasicGroupName&amp;quot;: &amp;quot;Group Name&amp;quot;, </div><div> &amp;quot;DescriptionFieldLabel&amp;quot;: &amp;quot;Description Field&amp;quot; </div>
<div> } </div><div> }); </div><div> ``` </div></div></div></div></div></div><div data-element-id="elm_iphr8pGoA2AIItCzHjGQ_Q" data-element-type="text" class="zpelement zpelem-text "><style> [data-element-id="elm_iphr8pGoA2AIItCzHjGQ_Q"].zpelem-text{ border-radius:1px; } </style><div class="zptext zptext-align-left " data-editor="true"><div style="color:inherit;"><p><br></p><p>The tricky part is that you need to keep all those files in sync, so it gets more complicated with the more languages you need to support. Our PointFire Localizer solution helps you localize your SPFx solution, so you do not have to worry about missing translations.</p></div>
</div></div><div data-element-id="elm_0rwyW5k0svX5PtcETZpU6A" data-element-type="heading" class="zpelement zpelem-heading "><style> [data-element-id="elm_0rwyW5k0svX5PtcETZpU6A"].zpelem-heading { border-radius:1px; } </style><h2 class="zpheading zpheading-style-none zpheading-align-left " data-editor="true"><div><div><h2><span style="font-size:20px;font-weight:700;font-family:&quot;Work Sans&quot;;color:rgb(11, 27, 45);">What is PointFire Localizer?</span></h2></div>
<div style="color:inherit;"><div></div></div></div></h2></div><div data-element-id="elm_dvbeYPBvGuniaypkVdMPkQ" data-element-type="text" class="zpelement zpelem-text "><style> [data-element-id="elm_dvbeYPBvGuniaypkVdMPkQ"].zpelem-text{ border-radius:1px; } </style><div class="zptext zptext-align-left " data-editor="true"><div style="color:inherit;"><p style="font-size:12pt;">PointFire Localizer is a GitHub Action that helps you translate your localization files for your SPFx solutions. The <a href="https://azure.microsoft.com/en-us/products/ai-services/ai-translator">Azure AI Translator</a> is used to translate your localization files to the desired languages.</p><p style="font-size:12pt;">&nbsp;</p><p style="font-size:12pt;">The GitHub Action adds the missing translations to your localization files so you can be sure that all key/value pairs are included in all languages. When a human has already translated a key, it will not be overwritten by machine translation. The GitHub Action favors human translations.</p><p style="font-size:12pt;">&nbsp;</p><p style="font-size:12pt;">Our GitHub Action is designed to be easily integrated into your existing build pipeline. Thus, you can automatically translate your localization files when you build your SPFx solution.</p></div>
</div></div><div data-element-id="elm_jluHSUVebuErv8KSIsCrKQ" data-element-type="heading" class="zpelement zpelem-heading "><style> [data-element-id="elm_jluHSUVebuErv8KSIsCrKQ"].zpelem-heading { border-radius:1px; } </style><h2 class="zpheading zpheading-style-none zpheading-align-left " data-editor="true"></h2><h2><span style="font-family:&quot;Work Sans&quot;;font-size:20px;font-weight:700;color:rgb(11, 27, 45);">How to use PointFire Localizer?</span></h2></div>
<div data-element-id="elm_gGf9h19PtpJz9tKchck2sw" data-element-type="text" class="zpelement zpelem-text "><style> [data-element-id="elm_gGf9h19PtpJz9tKchck2sw"].zpelem-text{ border-radius:1px; } </style><div class="zptext zptext-align-left " data-editor="true"><div style="color:inherit;"><p style="font-size:12pt;">As our builds are already running on GitHub Actions, we created a GitHub Action that can be used in your workflows. This way, you can easily integrate the localization process into your existing build pipeline, and you are sure that on release, all localization files will include all key/value pairs for all languages.</p><p style="font-size:12pt;">&nbsp;</p><p style="font-size:12pt;">Here you can see an example of a GitHub Actions workflow for packaging a SharePoint Framework solution:</p><p style="font-size:12pt;"><br></p><div style="color:inherit;"><span style="color:inherit;"><p><span style="font-size:12pt;">```yaml</span></p><p><span style="font-size:12pt;">name: Build</span></p><br><p><span style="font-size:12pt;">on:</span></p><p><span style="font-size:12pt;">&nbsp;push:</span></p><p><span style="font-size:12pt;">&nbsp;branches:</span></p><p><span style="font-size:12pt;">&nbsp;- dev</span></p><p><span style="font-size:12pt;">&nbsp;- main</span></p><p><span style="font-size:12pt;">&nbsp;workflow_dispatch:</span></p><br><p><span style="font-size:12pt;">jobs:</span></p><p><span style="font-size:12pt;">&nbsp;build:</span></p><p><span style="font-size:12pt;">&nbsp;runs-on: ubuntu-latest</span></p><p><span style="font-size:12pt;">&nbsp;steps:</span></p><p><span style="font-size:12pt;">&nbsp;- uses: actions/checkout@v4</span></p><br><p><span style="font-size:12pt;">&nbsp;- uses: actions/setup-node@v4</span></p><p><span style="font-size:12pt;">&nbsp;with:</span></p><p><span style="font-size:12pt;">&nbsp;node-version: 18</span></p><p><span style="font-size:12pt;">&nbsp;cache: 'npm'</span></p><br><p><span style="font-size:12pt;">&nbsp;- name: Install dependencies</span></p><p><span style="font-size:12pt;">&nbsp;run: npm ci</span></p><br><p><span style="font-size:12pt;">&nbsp;- name: Package solution</span></p><p><span style="font-size:12pt;">&nbsp;run: gulp bundle --ship &amp;&amp; gulp package-solution --ship</span></p><br><p><span style="font-size:12pt;">&nbsp;- name: Upload sppkg</span></p><p><span style="font-size:12pt;">&nbsp;uses: actions/upload-artifact@v4</span></p><p><span style="font-size:12pt;">&nbsp;with:</span></p><p><span style="font-size:12pt;">&nbsp;name: spfx-solution</span></p><p><span style="font-size:12pt;">&nbsp;path: ./**/sharepoint/solution/*.sppkg</span></p><p><span style="font-size:12pt;">```</span></p></span></div>
<p style="font-size:12pt;">&nbsp;</p></div></div></div><div data-element-id="elm_bDZ8NwlpAtC5TNWq6F0PxA" data-element-type="heading" class="zpelement zpelem-heading "><style> [data-element-id="elm_bDZ8NwlpAtC5TNWq6F0PxA"].zpelem-heading { border-radius:1px; } </style><h2 class="zpheading zpheading-style-none zpheading-align-left " data-editor="true"></h2><h3><span style="font-family:&quot;Work Sans&quot;;font-size:20px;font-weight:700;color:rgb(11, 27, 45);">Add the Azure AI Translator API key to your GitHub repository</span></h3></div>
<div data-element-id="elm_koTHOiZkoc1wxFVsRmdR7A" data-element-type="text" class="zpelement zpelem-text "><style> [data-element-id="elm_koTHOiZkoc1wxFVsRmdR7A"].zpelem-text{ border-radius:1px; } </style><div class="zptext zptext-align-left " data-editor="true"><div style="color:inherit;"><p style="font-size:12pt;">The prerequisite for using PointFire Localizer is that you have an Azure AI Translator service. You can create a new service in the Azure Portal. Once you have created the service, either the free or the paid tier, you can get the API key from the Azure Portal. You can find more information in the <a href="https://learn.microsoft.com/en-us/azure/ai-services/translator/create-translator-resource#get-your-authentication-keys-and-endpoint">get your authentication keys and endpoint</a> article.</p><p style="font-size:12pt;"><br></p><p style="font-size:12pt;"><span style="font-style:italic;"><span style="color:inherit;">You can make use of the free tier from Azure AI Translator.</span><br></span></p><p style="font-size:12pt;">&nbsp;</p><p style="font-size:12pt;">Follow the next steps to add your Azure AI Translator API key to your GitHub repository:</p><ul><li>Go to your GitHub repository</li><li>Go to the `Settings` tab</li><li>Go to the `Secrets and variables` section and click on `Actions`</li><li>Click on the `New repository secret` button</li><li>Add a new secret with the name `TRANSLATOR_API_KEY` and the value of your Azure AI Translator API key</li></ul><p style="font-size:12pt;">&nbsp;</p><p style="font-size:12pt;">Once you have added the Azure AI Translator API key to your GitHub repository, you can add the PointFire Localizer GitHub Action to your workflow.</p><p style="font-size:12pt;">&nbsp;</p><p style="font-size:12pt;">There are two ways how you can use PointFire Localizer in your workflow:</p><p style="font-size:12pt;">&nbsp;</p><p style="font-size:12pt;">1.<span style="font-size:7pt;">&nbsp; </span>By a predefined list of locales</p><p style="font-size:12pt;">2.<span style="font-size:7pt;">&nbsp; </span>By automatically detecting the locales</p></div>
</div></div><div data-element-id="elm_hIRUy9IXePFBxwfAffJYHQ" data-element-type="heading" class="zpelement zpelem-heading "><style> [data-element-id="elm_hIRUy9IXePFBxwfAffJYHQ"].zpelem-heading { border-radius:1px; } </style><h2 class="zpheading zpheading-style-none zpheading-align-left " data-editor="true"></h2><h3><span style="font-family:&quot;Work Sans&quot;;font-size:20px;font-weight:700;color:rgb(11, 27, 45);">Using a predefined list of locales</span></h3></div>
<div data-element-id="elm_iPvd8Oo5jM1SNeU3D3h3GQ" data-element-type="text" class="zpelement zpelem-text "><style> [data-element-id="elm_iPvd8Oo5jM1SNeU3D3h3GQ"].zpelem-text{ border-radius:1px; } </style><div class="zptext zptext-align-left " data-editor="true"><div style="color:inherit;"><p style="font-size:12pt;">If you want to use a predefined list of locales, you can add the following step to your workflow file right after the `install dependencies` step:</p><p style="font-size:12pt;"><br></p><p><span style="font-size:12pt;">```yaml</span></p><p><span style="font-size:12pt;">- name: PointFire Localizer</span></p><p><span style="font-size:12pt;">&nbsp;uses: IceFireStudios/pointfire-localizer-action@v1.0.0</span></p><p><span style="font-size:12pt;">&nbsp;with:</span></p><p><span style="font-size:12pt;">&nbsp;api-key: ${{ secrets.TRANSLATOR_API_KEY }}</span></p><p><span style="font-size:12pt;">&nbsp;api-region: "westeurope"</span></p><p><span style="font-size:12pt;">&nbsp;default-locale: "en-us"</span></p><p><span style="font-size:12pt;">&nbsp;locales: "nl-nl,fr-fr,de-de"</span></p><p><span style="font-size:12pt;">&nbsp;summary: true</span></p><p><span style="font-size:12pt;">```</span></p><p><span style="font-size:12pt;"><br></span></p></div>
</div></div><div data-element-id="elm_WQQSOVr23l3pakzs8glXEw" data-element-type="text" class="zpelement zpelem-text "><style> [data-element-id="elm_WQQSOVr23l3pakzs8glXEw"].zpelem-text{ border-radius:1px; } </style><div class="zptext zptext-align-left " data-editor="true"><div style="color:inherit;"><p style="font-size:12pt;">In this example, we use the predefined list of locales `nl-nl,fr-fr,de-de` and the default locale `en-us`.</p><p style="font-size:12pt;">&nbsp;</p><p style="font-size:12pt;">The GitHub Action will do the following:</p><p style="font-size:12pt;">&nbsp;</p><p style="font-size:12pt;">·<span style="font-size:7pt;">&nbsp;</span>It will first look for all the `en-us.js` files in the SPFx solution</p><p style="font-size:12pt;">·<span style="font-size:7pt;">&nbsp;</span>It will then translate all the missing or empty key/value pairs to the locales `nl-nl`, `fr-fr`, and `de-de`</p><p style="font-size:12pt;">o<span style="font-size:7pt;">&nbsp;</span>If a localization file does not exist, it will create a new one</p><p style="font-size:12pt;">o<span style="font-size:7pt;">&nbsp;</span>If a localization file already exists, it will add the missing key/value pairs</p><p style="font-size:12pt;">&nbsp;</p><p style="font-size:12pt;">The advantage of this approach is that those localization files can be created during the build process, so you do not have to make them manually if there are no human translations available.</p></div>
</div></div><div data-element-id="elm_tIua8ta12xrorHpa0mfC0Q" data-element-type="image" class="zpelement zpelem-image "><style> @media (min-width: 992px) { [data-element-id="elm_tIua8ta12xrorHpa0mfC0Q"] .zpimage-container figure img { width: 500px ; height: 261.56px ; } } @media (max-width: 991px) and (min-width: 768px) { [data-element-id="elm_tIua8ta12xrorHpa0mfC0Q"] .zpimage-container figure img { width:500px ; height:261.56px ; } } @media (max-width: 767px) { [data-element-id="elm_tIua8ta12xrorHpa0mfC0Q"] .zpimage-container figure img { width:500px ; height:261.56px ; } } [data-element-id="elm_tIua8ta12xrorHpa0mfC0Q"].zpelem-image { border-radius:1px; } </style><div data-caption-color="" data-size-tablet="" data-size-mobile="" data-align="left" data-tablet-image-separate="false" data-mobile-image-separate="false" class="zpimage-container zpimage-align-left zpimage-size-medium zpimage-tablet-fallback-medium zpimage-mobile-fallback-medium hb-lightbox " data-lightbox-options="
                type:fullscreen,
                theme:dark"><figure role="none" class="zpimage-data-ref"><span class="zpimage-anchor" role="link" tabindex="0" aria-label="Open Lightbox" style="cursor:pointer;"><picture><img class="zpimage zpimage-style-none zpimage-space-none " src="https://blog.icefire.ca/PointFire-Localizer-Githib-Localization-Summary.png" width="500" height="261.56" loading="lazy" size="medium" data-lightbox="true"></picture></span></figure></div>
</div><div data-element-id="elm_8QlHmyMIB04pp6O7JRAHqg" data-element-type="heading" class="zpelement zpelem-heading "><style> [data-element-id="elm_8QlHmyMIB04pp6O7JRAHqg"].zpelem-heading { border-radius:1px; } </style><h2 class="zpheading zpheading-style-none zpheading-align-left " data-editor="true"></h2><h3><span style="font-size:20px;font-family:&quot;Work Sans&quot;;font-weight:700;color:rgb(11, 27, 45);">Automatically detecting the locales</span></h3></div>
<div data-element-id="elm_uvEn1MpGi-9y44oI5n2kzQ" data-element-type="text" class="zpelement zpelem-text "><style> [data-element-id="elm_uvEn1MpGi-9y44oI5n2kzQ"].zpelem-text{ border-radius:1px; } </style><div class="zptext zptext-align-left " data-editor="true"><div style="color:inherit;"><p style="font-size:12pt;">If you want to detect the locales automatically, you can add the following step to your workflow file right after the `install dependencies` step:</p><p style="font-size:12pt;"><br></p><p><span style="font-size:12pt;">```yaml</span></p><p><span style="font-size:12pt;">- name: PointFire Localizer</span></p><p><span style="font-size:12pt;">&nbsp;uses: IceFireStudios/pointfire-localizer-action@v1.0.0</span></p><p><span style="font-size:12pt;">&nbsp;with:</span></p><p><span style="font-size:12pt;">&nbsp;api-key: ${{ secrets.TRANSLATOR_API_KEY }}</span></p><p><span style="font-size:12pt;">&nbsp;api-region: "westeurope"</span></p><p><span style="font-size:12pt;">&nbsp;default-locale: "en-us"</span></p><p><span style="font-size:12pt;">&nbsp;summary: true</span></p><p><span style="font-size:12pt;">```</span></p><p style="font-size:12pt;"><span style="color:inherit;"></span></p><div><span style="font-size:12pt;"><br></span></div>
</div></div></div><div data-element-id="elm_cPWaOlFiUIKFSEPotrBrcg" data-element-type="text" class="zpelement zpelem-text "><style> [data-element-id="elm_cPWaOlFiUIKFSEPotrBrcg"].zpelem-text{ border-radius:1px; } </style><div class="zptext zptext-align-left " data-editor="true"><div style="color:inherit;"><p style="font-size:12pt;">In this example, we are using the default locale `en-us`. As we did not specify any locales, the GitHub Action will automatically detect them based on the existing localization files.</p><p style="font-size:12pt;">&nbsp;</p><p style="font-size:12pt;">The GitHub Action will do the following:</p><p style="font-size:12pt;">&nbsp;</p><p style="font-size:12pt;">·<span style="font-size:7pt;">&nbsp;</span>It will first look for all the `en-us.js` files in the SPFx solution</p><p style="font-size:12pt;">·<span style="font-size:7pt;">&nbsp;</span>It will retrieve the linked locales per the default locale</p><p style="font-size:12pt;">·<span style="font-size:7pt;">&nbsp;</span>It will then translate all the missing or empty key/value pairs to the linked locales</p><p style="font-size:12pt;">&nbsp;</p><p style="font-size:12pt;">In this case, the GitHub Action will only translate the existing locale files in the SPFx solution.</p></div>
</div></div><div data-element-id="elm_cblqxh7jiVu4GYOm1LWGzQ" data-element-type="image" class="zpelement zpelem-image "><style> @media (min-width: 992px) { [data-element-id="elm_cblqxh7jiVu4GYOm1LWGzQ"] .zpimage-container figure img { width: 500px ; height: 261.56px ; } } @media (max-width: 991px) and (min-width: 768px) { [data-element-id="elm_cblqxh7jiVu4GYOm1LWGzQ"] .zpimage-container figure img { width:500px ; height:261.56px ; } } @media (max-width: 767px) { [data-element-id="elm_cblqxh7jiVu4GYOm1LWGzQ"] .zpimage-container figure img { width:500px ; height:261.56px ; } } [data-element-id="elm_cblqxh7jiVu4GYOm1LWGzQ"].zpelem-image { border-radius:1px; } </style><div data-caption-color="" data-size-tablet="" data-size-mobile="" data-align="left" data-tablet-image-separate="false" data-mobile-image-separate="false" class="zpimage-container zpimage-align-left zpimage-size-medium zpimage-tablet-fallback-medium zpimage-mobile-fallback-medium hb-lightbox " data-lightbox-options="
                type:fullscreen,
                theme:dark"><figure role="none" class="zpimage-data-ref"><span class="zpimage-anchor" role="link" tabindex="0" aria-label="Open Lightbox" style="cursor:pointer;"><picture><img class="zpimage zpimage-style-none zpimage-space-none " src="https://blog.icefire.ca/PointFire-Localizer-Githib-Localization-Summary-2.png" width="500" height="261.56" loading="lazy" size="medium" data-lightbox="true"></picture></span></figure></div>
</div></div></div></div></div></div>]]></content:encoded><pubDate>Mon, 25 Mar 2024 15:02:44 -0400</pubDate></item><item><title><![CDATA[Is GPT better at translating than translation engines?]]></title><link>https://blog.icefire.ca/blogs/post/is-gpt-better-at-translating-than-translation-engines</link><description><![CDATA[<img align="left" hspace="5" src="https://blog.icefire.ca/languages.png"/>Generative Pre-trained Transformer (GPT) systems are not designed to be translation engines. So it is surprising that they succeed so well at doing simple translations. Some articles have claimed that they can translate better than existing translation engines. How true are those claims?]]></description><content:encoded><![CDATA[<div class="zpcontent-container blogpost-container "><div data-element-id="elm_tDbLseMrQ1atvh_reNkSWg" data-element-type="section" class="zpsection "><style type="text/css"></style><div class="zpcontainer-fluid zpcontainer"><div data-element-id="elm_UVV3AohDQdGTvwDADeeliw" data-element-type="row" class="zprow zprow-container zpalign-items- zpjustify-content- " data-equal-column=""><style type="text/css"> [data-element-id="elm_UVV3AohDQdGTvwDADeeliw"].zprow{ border-radius:1px; } </style><div data-element-id="elm_BTUzPodyT4CO85UyifeZEA" data-element-type="column" class="zpelem-col zpcol-12 zpcol-md-12 zpcol-sm-12 zpalign-self- "><style type="text/css"> [data-element-id="elm_BTUzPodyT4CO85UyifeZEA"].zpelem-col{ border-radius:1px; } </style><div data-element-id="elm_f3ptpRwjce2pziid40quFg" data-element-type="text" class="zpelement zpelem-text "><style> [data-element-id="elm_f3ptpRwjce2pziid40quFg"].zpelem-text{ border-radius:1px; } </style><div class="zptext zptext-align-left " data-editor="true"><div style="color:inherit;"><p>Generative Pre-trained Transformer (GPT) systems are not designed to be translation engines.&nbsp; So it is surprising that they succeed so well at doing simple translations.&nbsp; Some articles have claimed that they can translate better than existing translation engines.&nbsp; How true are those claims?</p></div>
</div></div><div data-element-id="elm_wwrYpJJnyynTEBW1VCGNaw" data-element-type="text" class="zpelement zpelem-text "><style> [data-element-id="elm_wwrYpJJnyynTEBW1VCGNaw"].zpelem-text{ border-radius:1px; } </style><div class="zptext zptext-align-left " data-editor="true"><p><span style="color:inherit;">Most of those claims are based on testing with a few sentences chosen by the author, few language pairs, and a qualitative scoring of how good the translation is.&nbsp; However, more systematic evaluations with large samples of more types of text, more languages, and more objective quality scoring by machines and humans tell a different story.</span><br></p></div>
</div><div data-element-id="elm_46LFSwHNzt6gdr8LjAh8NQ" data-element-type="text" class="zpelement zpelem-text "><style> [data-element-id="elm_46LFSwHNzt6gdr8LjAh8NQ"].zpelem-text{ border-radius:1px; } </style><div class="zptext zptext-align-left " data-editor="true"><div style="color:inherit;"><p>The best comprehensive evaluation was done by scientists at Microsoft Research, unsurprising because they are among the leaders in both machine translation and GPT models.&nbsp; The brief summary is that while GPT models have competitive quality when translating usual sentences from a major (see high-resource below) language to English, they are less good at other types of translation.</p></div>
</div></div><div data-element-id="elm_N7pEJJlKArL38OQeyi1R3Q" data-element-type="text" class="zpelement zpelem-text "><style> [data-element-id="elm_N7pEJJlKArL38OQeyi1R3Q"].zpelem-text{ border-radius:1px; } </style><div class="zptext zptext-align-left " data-editor="true"><div style="color:inherit;"><p>The evaluation uses three GPT systems that are known for translation quality, and compares them with neural machine translation engines (NMT), either Microsoft Azure API or the best-performing commercial systems or research prototype.&nbsp; Quality scoring uses either algorithmic scoring or human evaluation.</p></div>
</div></div><div data-element-id="elm_hPgLpVu7xvZTX8EVf8QoUg" data-element-type="text" class="zpelement zpelem-text "><style> [data-element-id="elm_hPgLpVu7xvZTX8EVf8QoUg"].zpelem-text{ border-radius:1px; } </style><div class="zptext zptext-align-left " data-editor="true"><div style="color:inherit;"><p><a href="https://arxiv.org/pdf/2302.09210.pdf" title="How Good Are GPT Models at Machine Translation? A Comprehensive Evaluation&nbsp;" rel="">How Good Are GPT Models at Machine Translation? A Comprehensive Evaluation</a>&nbsp;<br></p><div><br></div>
</div></div></div><div data-element-id="elm_ivvprsnnnhFmrXoNaiJMfw" data-element-type="heading" class="zpelement zpelem-heading "><style> [data-element-id="elm_ivvprsnnnhFmrXoNaiJMfw"].zpelem-heading { border-radius:1px; } </style><h3 class="zpheading zpheading-style-none zpheading-align-left " data-editor="true"><div><p>Languages and language direction</p></div></h3></div>
<div data-element-id="elm_OYh0FJo0e1jQwh74F41YlA" data-element-type="text" class="zpelement zpelem-text "><style> [data-element-id="elm_OYh0FJo0e1jQwh74F41YlA"].zpelem-text{ border-radius:1px; } </style><div class="zptext zptext-align-left " data-editor="true"><div style="color:inherit;"><p>In most languages and for language directions, MS Azure Translator and other NMT engines outperform GPT for most measures of quality.&nbsp; However, GPT does have the ability to improve after being given a few examples of correct translations, and to outperform NMT in some language directions after 5 tries.&nbsp; This is the case for translations to English from German, Chinese and Japanese, languages for which there are a lot of examples in the GPT training set.&nbsp; These are called “high-resource” languages.&nbsp; On the other hand, it does not do particularly well for low-resource languages like Czech or Icelandic, or for English to other languages.&nbsp; GPT’s training set had less text in those languages.&nbsp; In the chart below, orange is GPT and blue is NMT.&nbsp; The lines are algorithmic evaluation and the bars are human evaluation.</p></div>
</div></div><div data-element-id="elm_4GnKGtHJ6wbcwAK1NGEjCg" data-element-type="image" class="zpelement zpelem-image "><style> @media (min-width: 992px) { [data-element-id="elm_4GnKGtHJ6wbcwAK1NGEjCg"] .zpimage-container figure img { width: 624px !important ; height: 398px !important ; } } @media (max-width: 991px) and (min-width: 768px) { [data-element-id="elm_4GnKGtHJ6wbcwAK1NGEjCg"] .zpimage-container figure img { width:624px ; height:398px ; } } @media (max-width: 767px) { [data-element-id="elm_4GnKGtHJ6wbcwAK1NGEjCg"] .zpimage-container figure img { width:624px ; height:398px ; } } [data-element-id="elm_4GnKGtHJ6wbcwAK1NGEjCg"].zpelem-image { border-radius:1px; } </style><div data-caption-color="" data-size-tablet="" data-size-mobile="" data-align="center" data-tablet-image-separate="false" data-mobile-image-separate="false" class="zpimage-container zpimage-align-center zpimage-size-original zpimage-tablet-fallback-original zpimage-mobile-fallback-original hb-lightbox " data-lightbox-options="
                type:fullscreen,
                theme:dark"><figure role="none" class="zpimage-data-ref"><span class="zpimage-anchor" role="link" tabindex="0" aria-label="Open Lightbox" style="cursor:pointer;"><picture><img class="zpimage zpimage-style-none zpimage-space-none " src="https://blog.icefire.ca/languages.png" width="624" height="398" loading="lazy" size="original" data-lightbox="true"></picture></span></figure></div>
</div><div data-element-id="elm_Trbv_VsvOl0UReU8UqOXpA" data-element-type="heading" class="zpelement zpelem-heading "><style> [data-element-id="elm_Trbv_VsvOl0UReU8UqOXpA"].zpelem-heading { border-radius:1px; } </style><h3 class="zpheading zpheading-style-none zpheading-align-left " data-editor="true"><div><div><p>Sentence-level vs. multi-sentence</p></div>
</div></h3></div><div data-element-id="elm_4PSNPeNPm7jG976XCnkNSQ" data-element-type="text" class="zpelement zpelem-text "><style> [data-element-id="elm_4PSNPeNPm7jG976XCnkNSQ"].zpelem-text{ border-radius:1px; } </style><div class="zptext zptext-align-left " data-editor="true"><div style="color:inherit;"><p>Those experiments above are for sentence-level translations.&nbsp; For multi-sentence translations, those with more context that can be found in other sentences, GPT improves relative to NMT.&nbsp; Not enough to beat the best NMT systems, but sometimes enough to match or beat the normal Azure API.&nbsp; That is not very surprising: Azure Translator was optimized for sentence-level translation, while GPT is trained for multi-sentence context, up to thousands of words.&nbsp; Other Azure translation APIs like Document Translator and Custom Translator are better at longer context windows, but this is not what was tested here.&nbsp;</p></div>
</div></div><div data-element-id="elm_13pYmoMB8Ri4gFMkS-ersw" data-element-type="text" class="zpelement zpelem-text "><style> [data-element-id="elm_13pYmoMB8Ri4gFMkS-ersw"].zpelem-text{ border-radius:1px; } </style><div class="zptext zptext-align-left " data-editor="true"><div style="color:inherit;"><p>Neural Machine Translation models have another big advantage over GPT: they can be re-trained for a particular domain rather than with general domains, and this significantly improves their quality score for that domain.&nbsp; For example, by giving it many training examples of automotive documents, Azure Custom Translator (a re-trainable version of Azure Translator) can increase its translation quality for documents in the automotive domain by a large factor.</p></div>
</div></div><div data-element-id="elm_MiC-NQB9r4oyIjEzaBo6HQ" data-element-type="heading" class="zpelement zpelem-heading "><style> [data-element-id="elm_MiC-NQB9r4oyIjEzaBo6HQ"].zpelem-heading { border-radius:1px; } </style><h3 class="zpheading zpheading-style-none zpheading-align-left " data-editor="true"><div><div><p>Fluency and alignment</p></div>
</div></h3></div><div data-element-id="elm_OnDZyqsMG88uqB5qjbGWOQ" data-element-type="text" class="zpelement zpelem-text "><style> [data-element-id="elm_OnDZyqsMG88uqB5qjbGWOQ"].zpelem-text{ border-radius:1px; } </style><div class="zptext zptext-align-left " data-editor="true"><div style="color:inherit;"><p>Looking at other measures of performance gives a better understanding of what is different in the performance of the GPT vs. NMT.&nbsp; Measuring fluency, essentially how natural is the sentence, how similar it is to other sentences out in the world, tells you something about the quality of the prose.&nbsp; GPT is more fluent in English, it sounds more natural.&nbsp; That doesn’t mean that it is a more accurate translation, far from it.&nbsp; In fact, GPT has a greater tendency to add words, concepts, and punctuation that do not correspond to the original, or to omit some.&nbsp; So it’s good prose, but it’s not necessarily what the original said.&nbsp; For example, it does better at figures of speech, by not translating them literally, but also does not necessarily replace it with a term that means exactly the same thing.&nbsp; It does not wander far from the original with completely made-up things, but it’s often not quite correct.&nbsp; However GPT also does hallucinate words or concepts that were not in the original.<br></p><div><div style="color:inherit;"><p><br></p><p><a href="https://arxiv.org/abs/2305.16806" title="Do GPTs Produce Less Literal Translations?" rel="">Do GPTs Produce Less Literal Translations?</a>&nbsp;</p></div>
</div></div></div></div><div data-element-id="elm_em5DmpwzIvEOv7gi25W58w" data-element-type="image" class="zpelement zpelem-image "><style> @media (min-width: 992px) { [data-element-id="elm_em5DmpwzIvEOv7gi25W58w"] .zpimage-container figure img { width: 463px !important ; height: 127px !important ; } } @media (max-width: 991px) and (min-width: 768px) { [data-element-id="elm_em5DmpwzIvEOv7gi25W58w"] .zpimage-container figure img { width:463px ; height:127px ; } } @media (max-width: 767px) { [data-element-id="elm_em5DmpwzIvEOv7gi25W58w"] .zpimage-container figure img { width:463px ; height:127px ; } } [data-element-id="elm_em5DmpwzIvEOv7gi25W58w"].zpelem-image { border-radius:1px; } </style><div data-caption-color="" data-size-tablet="" data-size-mobile="" data-align="center" data-tablet-image-separate="false" data-mobile-image-separate="false" class="zpimage-container zpimage-align-center zpimage-size-original zpimage-tablet-fallback-original zpimage-mobile-fallback-original hb-lightbox " data-lightbox-options="
                type:fullscreen,
                theme:dark"><figure role="none" class="zpimage-data-ref"><span class="zpimage-anchor" role="link" tabindex="0" aria-label="Open Lightbox" style="cursor:pointer;"><picture><img class="zpimage zpimage-style-none zpimage-space-none " src="https://blog.icefire.ca/idiom.png" width="463" height="127" loading="lazy" size="original" data-lightbox="true"></picture></span></figure></div>
</div><div data-element-id="elm_xBGZxVb8PgHqZB19limLNw" data-element-type="heading" class="zpelement zpelem-heading "><style> [data-element-id="elm_xBGZxVb8PgHqZB19limLNw"].zpelem-heading { border-radius:1px; } </style><h3 class="zpheading zpheading-style-none zpheading-align-left " data-editor="true"><div><div><p>Translationese</p></div>
</div></h3></div><div data-element-id="elm_2e2-K-qRJowsZrrZcmfFOA" data-element-type="text" class="zpelement zpelem-text "><style> [data-element-id="elm_2e2-K-qRJowsZrrZcmfFOA"].zpelem-text{ border-radius:1px; } </style><div class="zptext zptext-align-left " data-editor="true"><div style="color:inherit;"><p>A literal and faithful translation is sometimes required, but that often leads to what is called “translationese”.&nbsp; This refers to a set of common issues with text generated by human translators.&nbsp; Translationese can refer to excessive precision or wordiness, or excessive vagueness in translated text, or syntax that is uncommon in the target language.&nbsp; What translators are compensating for is the fact that different languages are specific about different things.&nbsp; For example, English has the term “uncle”, which does not differentiate between paternal and maternal uncle or uncles by blood or marriage, but many other languages are much more specific.&nbsp; Translating from those other languages to English, Translationese would not say “uncle” but might say “maternal uncle by marriage”, a term that is unusual in English, but which avoids losing information that was contained in the original.&nbsp; In terms of translation quality, humans who are not translators might rate the translation with “uncle” higher because it sounds more natural, but translators would rate the awkward translation higher because it is more accurate.</p><p><br></p><p><span style="color:inherit;"><a href="https://arxiv.org/abs/2104.07623" title="Sometimes We Want Translationese" rel="">Sometimes We Want Translationese</a></span><br></p></div>
</div></div><div data-element-id="elm_1v3UqmUWI0PY_kDgHNpFEg" data-element-type="heading" class="zpelement zpelem-heading "><style> [data-element-id="elm_1v3UqmUWI0PY_kDgHNpFEg"].zpelem-heading { border-radius:1px; } </style><h3 class="zpheading zpheading-style-none zpheading-align-left " data-editor="true"><div><div><p>Design and training of GPT and NMT</p></div>
</div></h3></div><div data-element-id="elm_TrxEYA97NeXggnNFOH0fDw" data-element-type="text" class="zpelement zpelem-text "><style> [data-element-id="elm_TrxEYA97NeXggnNFOH0fDw"].zpelem-text{ border-radius:1px; } </style><div class="zptext zptext-align-left " data-editor="true"><div style="color:inherit;"><div style="color:inherit;"><p>There are big differences between the texts used to train GPT engines and the texts used to train NMT engines.&nbsp; GPT engines are trained on unilingual text found on the internet, mostly in English.&nbsp; For any sequence of words, GPT learns the most likely next word.&nbsp; NMT engines are trained on curated professionally translated sentences, pairs of original sentences and their translations.&nbsp; For all the curation, these data sets are often noisy and include incorrect translations that set back the training.&nbsp; For any sentence within a document in the source language, NMT predicts the translated sentence.&nbsp; This is part of the reason why NMT learns to produce translationese and GPT does not: it’s in the training set.</p></div>
</div></div></div><div data-element-id="elm_C4pvHsnS1vHjjdqyrrTqOw" data-element-type="text" class="zpelement zpelem-text "><style> [data-element-id="elm_C4pvHsnS1vHjjdqyrrTqOw"].zpelem-text{ border-radius:1px; } </style><div class="zptext zptext-align-left " data-editor="true"><div style="color:inherit;"><p>The design of the two types of models is also different. The “T” in GPT stands for “Transformer”.&nbsp; Transformer is an attention-based neural network model that when looking at a word within a sentence or even longer text, determines which other words are the most relevant ones to pay attention to.&nbsp; NMT also uses Transformer models.&nbsp; However, there are big differences.&nbsp; One is that GPT uses Decoder models, while NMT uses Encoder-decoder models.&nbsp; What does that mean?&nbsp; Decoder models focus on the output, the next word to be spit out.&nbsp; Encoder-decoder models try to extract features from the input before feeding it to the part of the model that predicts the output.&nbsp; It focuses separately on the input and on the output.&nbsp; It tries to be robust to small changes in the input.</p></div>
</div></div><div data-element-id="elm_ZFFoET6GwZJ40lJm9kkBrA" data-element-type="text" class="zpelement zpelem-text "><style> [data-element-id="elm_ZFFoET6GwZJ40lJm9kkBrA"].zpelem-text{ border-radius:1px; } </style><div class="zptext zptext-align-left " data-editor="true"><div style="color:inherit;"><p>GPT only outputs one word at a time.&nbsp; It starts with the text of the prompt plus other information in the input, then outputs a single word.&nbsp; Then it adds that word to the end of the prompt in the input and puts this new input through again to get the next word.&nbsp; It is unidirectional, that is to say when it is generating text it only looks at the previous words that are already generated, it doesn’t consider what it will say next because it hasn’t said it yet. Like a lot of humans, GPT is more concerned with what it wants to say next than with what you’re saying. &nbsp;NMT is bidirectional.&nbsp; It considers the rest of the sentence and the next sentence in both the source and the translation while it is generating the text.&nbsp; It generates entire sentences at once.</p></div>
</div></div><div data-element-id="elm_yIisgdweYhX48cbBcwa4wg" data-element-type="text" class="zpelement zpelem-text "><style> [data-element-id="elm_yIisgdweYhX48cbBcwa4wg"].zpelem-text{ border-radius:1px; } </style><div class="zptext zptext-align-left " data-editor="true"><div style="color:inherit;"><p>Because it is a generative model, GPT is biased towards what is usual.&nbsp; If the original text in the other language is commonplace and expected, then GPT will find good ways to express that text in English in ways that are commonplace and expected, because that is what it is trained to do.&nbsp; If the original says something that is unexpected or expresses it in unexpected ways, GPT’s translation is likely to replace it with something more usual using some of the same words.&nbsp; GPT does well at translation essentially because most things that require translation are predictable and unoriginal.</p></div>
</div></div><div data-element-id="elm_XU06fCYNGFWKXyoER9rTUw" data-element-type="text" class="zpelement zpelem-text "><style> [data-element-id="elm_XU06fCYNGFWKXyoER9rTUw"].zpelem-text{ border-radius:1px; } </style><div class="zptext zptext-align-left " data-editor="true"><div style="color:inherit;"><p>NMTs have a whole bag of tricks to deal with translation tasks that GPT does not, including specialized knowledge about the structure of languages, and tricks to deal with numbers, capitalization, and non-standard spacing correctly and efficiently.&nbsp; They are also trained to preserve information.&nbsp; You know that trick that people sometimes use, translating a sentence to another language then back to English so they can laugh at the result?&nbsp; NMTs include that round-trip in their training, to make sure that none of the meaning gets lost in the translation.&nbsp; Other tricks include having the neural network teach another neural network how to translate, detecting errors in the training data, and other tricks that address common translation errors.&nbsp; There are also tricks to reduce gender bias, a problem that still plagues GPT.</p></div>
</div></div><div data-element-id="elm_36dwuF6_ONEOJ5UGuuNZhw" data-element-type="heading" class="zpelement zpelem-heading "><style> [data-element-id="elm_36dwuF6_ONEOJ5UGuuNZhw"].zpelem-heading { border-radius:1px; } </style><h3 class="zpheading zpheading-style-none zpheading-align-left " data-editor="true"><div><div><div><p>Computing power required</p></div>
</div></div></h3></div><div data-element-id="elm_968TT3XKXbL3DR-Ht9w_3g" data-element-type="text" class="zpelement zpelem-text "><style> [data-element-id="elm_968TT3XKXbL3DR-Ht9w_3g"].zpelem-text{ border-radius:1px; } </style><div class="zptext zptext-align-left " data-editor="true"><div style="color:inherit;"><p>Current Azure Translator NMT uses models of about 50 million parameters, which can run 4 language pairs in a Docker container on a host having a 2-core CPU with 2 GB memory.&nbsp; Even the next generation of NMTs, <a href="https://blog.icefire.ca/blogs/post/how-to-get-a-higher-level-of-machine-translation-quality" title="Z-code MoE" rel="">Z-code MoE</a>, which have 100 languages (10,000 language pairs) in a single model, can fit on a single GPU even though they have billions or hundreds of billions of parameters.&nbsp; These are sizes for querying, what is required for training is much bigger.&nbsp; GPT-4 uses 100 trillion parameters.&nbsp; Training requires hundreds of thousands of CPUs and tens of thousands of GPUs, but to query them, it looks like a single cluster of 8 GPUs and a dozen or two CPUs is what is required.&nbsp; Microsoft is very good at shrinking by orders of magnitude the size of machines required to run AI models so direct comparison is difficult, but NMTs deliver translations at much lower computational cost.&nbsp; Microsoft’s DeepSpeed library in particular increases speed and reduces latency by a large factor.</p><p><br></p><p>The computing power required also has a potential impact on security.&nbsp; NMTs, even the bigger potential NMTs can be run on a single processor, while GPT requires many processors.&nbsp; Using GPT you are probably sharing hardware with strangers, while for NMT it is possible to have dedicated resources.&nbsp; Because of its recurrent architecture, where the output is fed back into the input, GPT probably has some static storage of your data, while NMT can be architected with a pipeline where neither the input nor output text is ever stored.&nbsp; I don't know how it is implemented by anyone, but I notice that for Azure, NMT has a no-trace option by default while GPT limited access previews do not.&nbsp; Because of ethical concerns, data is probably retained for abuse monitoring.&nbsp; I'm sure the security is good, but the architecture reduces the options for security.</p></div>
</div></div><div data-element-id="elm_azlB0lmtdPdOlibqoksLHQ" data-element-type="image" class="zpelement zpelem-image "><style> @media (min-width: 992px) { [data-element-id="elm_azlB0lmtdPdOlibqoksLHQ"] .zpimage-container figure img { width: 1110px ; height: 713.35px ; } } @media (max-width: 991px) and (min-width: 768px) { [data-element-id="elm_azlB0lmtdPdOlibqoksLHQ"] .zpimage-container figure img { width:723px ; height:464.64px ; } } @media (max-width: 767px) { [data-element-id="elm_azlB0lmtdPdOlibqoksLHQ"] .zpimage-container figure img { width:415px ; height:266.70px ; } } [data-element-id="elm_azlB0lmtdPdOlibqoksLHQ"].zpelem-image { border-radius:1px; } </style><div data-caption-color="" data-size-tablet="" data-size-mobile="" data-align="center" data-tablet-image-separate="false" data-mobile-image-separate="false" class="zpimage-container zpimage-align-center zpimage-size-fit zpimage-tablet-fallback-fit zpimage-mobile-fallback-fit hb-lightbox " data-lightbox-options="
                type:fullscreen,
                theme:dark"><figure role="none" class="zpimage-data-ref"><span class="zpimage-anchor" role="link" tabindex="0" aria-label="Open Lightbox" style="cursor:pointer;"><picture><img class="zpimage zpimage-style-none zpimage-space-none " src="https://blog.icefire.ca/performance.jpg" width="415" height="266.70" loading="lazy" size="fit" data-lightbox="true"></picture></span></figure></div>
</div><div data-element-id="elm_DOtJj3rG9dVwXmZBaX0S3A" data-element-type="heading" class="zpelement zpelem-heading "><style> [data-element-id="elm_DOtJj3rG9dVwXmZBaX0S3A"].zpelem-heading { border-radius:1px; } </style><h2 class="zpheading zpheading-style-none zpheading-align-left " data-editor="true">Conclusion</h2></div>
<div data-element-id="elm_XFr0lnW8TS4_CtxFNGC9gg" data-element-type="text" class="zpelement zpelem-text "><style> [data-element-id="elm_XFr0lnW8TS4_CtxFNGC9gg"].zpelem-text{ border-radius:1px; } </style><div class="zptext zptext-align-left " data-editor="true"><div style="color:inherit;"><p>The blanket claim that GPT is better at translation in not generally true.&nbsp; However GPT is surprisingly good, considering that translation is a task that it was neither designed nor trained for.&nbsp; It is unexpected that it is sometimes equal to or better than the highly specialized NMTs.&nbsp; There is a fair bit of work being done on hybrid systems that combine the accuracy and specialized training of NMT with the fluency of GPT and will deliver the best of both. The next generation of NMT (see <span style="color:inherit;"><a href="https://blog.icefire.ca/blogs/post/how-to-get-a-higher-level-of-machine-translation-quality" title="How to get a higher level of machine translation quality" rel="">How to get a higher level of machine translation quality</a></span><span style="color:inherit;">) will also allow the model to transfer language knowledge obtained from one language to other related languages, and in that way vastly improve the quality for low-resource languages such as southern Slavic languages.&nbsp; That innate knowledge of what is common to languages in the same family can then be used to improve the quality of both NMT and GPT.</span></p><div><br></div>
<div><div style="color:inherit;"><p><a href="https://arxiv.org/abs/2309.11674" title="A Paradigm Shift in Machine Translation: Boosting Translation Performance of Large Language Models" rel="">A Paradigm Shift in Machine Translation: Boosting Translation Performance of Large Language Models</a>&nbsp;<br></p><div><br></div>
</div></div></div></div></div></div></div></div></div></div>]]></content:encoded><pubDate>Fri, 06 Oct 2023 09:30:00 -0400</pubDate></item><item><title><![CDATA[Trick to Uncripple Teams Private Channel Sites]]></title><link>https://blog.icefire.ca/blogs/post/trick-to-uncripple-teams-private-channel-sites</link><description><![CDATA[<img align="left" hspace="5" src="https://blog.icefire.ca/SharePoint-cant-add-app-PointFire-blog.png"/>Here is a trick that I never realized was not common knowledge. When you create a private channel in Teams, its SharePoint site can’t add certain apps, both custom apps and standard ones, including Calendar and Tasks.]]></description><content:encoded><![CDATA[<div class="zpcontent-container blogpost-container "><div data-element-id="elm_NcmVIDTBQXWi2cJY3wMk-Q" data-element-type="section" class="zpsection "><style type="text/css"></style><div class="zpcontainer-fluid zpcontainer"><div data-element-id="elm_KUvcHjd-REuU1FyFUIBYYw" data-element-type="row" class="zprow zprow-container zpalign-items- zpjustify-content- " data-equal-column=""><style type="text/css"></style><div data-element-id="elm_RecNDb8eS1G4l7knMS2MeQ" data-element-type="column" class="zpelem-col zpcol-12 zpcol-md-12 zpcol-sm-12 zpalign-self- "><style type="text/css"></style><div data-element-id="elm_EHy8b2xOQXCtzJTvM0M5Vw" data-element-type="text" class="zpelement zpelem-text "><style> [data-element-id="elm_EHy8b2xOQXCtzJTvM0M5Vw"].zpelem-text{ border-radius:1px; } </style><div class="zptext zptext-align-center " data-editor="true"><div style="color:inherit;"><div style="color:inherit;"><p style="text-align:left;"><span style="font-size:16px;">Here is a trick that I never realized was not common knowledge.&nbsp; When you create a private channel in Teams, its SharePoint site can’t add certain apps, both custom apps and standard ones, including Calendar and Tasks.</span></p><p style="text-align:left;"><span style="font-size:16px;"><br></span></p><p style="text-align:left;"><span style="font-size:16px;">TLDR: Enable-PnPFeature 73EF14B1-13A9-416b-A9B5-ECECA2B0604C -Scope Site -Force</span></p><p style="text-align:left;"><span style="font-size:16px;"><br></span></p><p style="text-align:left;"><span style="font-size:16px;">Now for the longer explanation.&nbsp; When you try to add an app to this type of site, you find very few options in Modern view.</span></p><p style="text-align:left;"><span style="font-size:16px;"><br></span></p></div>
</div></div></div><div data-element-id="elm_lf5aKi2hoOPIh1gYnsuRqg" data-element-type="image" class="zpelement zpelem-image "><style> @media (min-width: 992px) { [data-element-id="elm_lf5aKi2hoOPIh1gYnsuRqg"] .zpimage-container figure img { width: 1110px ; height: 526.61px ; } } @media (max-width: 991px) and (min-width: 768px) { [data-element-id="elm_lf5aKi2hoOPIh1gYnsuRqg"] .zpimage-container figure img { width:723px ; height:343.01px ; } } @media (max-width: 767px) { [data-element-id="elm_lf5aKi2hoOPIh1gYnsuRqg"] .zpimage-container figure img { width:415px ; height:196.89px ; } } [data-element-id="elm_lf5aKi2hoOPIh1gYnsuRqg"].zpelem-image { border-radius:1px; } </style><div data-caption-color="" data-size-tablet="" data-size-mobile="" data-align="left" data-tablet-image-separate="false" data-mobile-image-separate="false" class="zpimage-container zpimage-align-left zpimage-size-fit zpimage-tablet-fallback-fit zpimage-mobile-fallback-fit hb-lightbox " data-lightbox-options="
                type:fullscreen,
                theme:dark"><figure role="none" class="zpimage-data-ref"><span class="zpimage-anchor" role="link" tabindex="0" aria-label="Open Lightbox" style="cursor:pointer;"><picture><img class="zpimage zpimage-style-none zpimage-space-none " src="https://blog.icefire.ca/SharePoint-modern-view-PointFire-blog.png" width="415" height="196.89" loading="lazy" size="fit" data-lightbox="true"></picture></span></figure></div>
</div><div data-element-id="elm_2OH8JyKl3Mp_NZ9-2y21JA" data-element-type="text" class="zpelement zpelem-text "><style> [data-element-id="elm_2OH8JyKl3Mp_NZ9-2y21JA"].zpelem-text{ border-radius:1px; } </style><div class="zptext zptext-align-left " data-editor="true"><p><br></p><div style="color:inherit;"><div style="color:inherit;"><p><span style="font-size:16px;">Click on “classic experience” and you get a few more, but not nearly as many as you get for normal sites.</span></p><p style="font-size:11pt;"><br></p></div>
</div></div></div><div data-element-id="elm_HyMNuRaUC-DRKDbamQRsjQ" data-element-type="image" class="zpelement zpelem-image "><style> @media (min-width: 992px) { [data-element-id="elm_HyMNuRaUC-DRKDbamQRsjQ"] .zpimage-container figure img { width: 1110px ; height: 708.08px ; } } @media (max-width: 991px) and (min-width: 768px) { [data-element-id="elm_HyMNuRaUC-DRKDbamQRsjQ"] .zpimage-container figure img { width:723px ; height:461.21px ; } } @media (max-width: 767px) { [data-element-id="elm_HyMNuRaUC-DRKDbamQRsjQ"] .zpimage-container figure img { width:415px ; height:264.73px ; } } [data-element-id="elm_HyMNuRaUC-DRKDbamQRsjQ"].zpelem-image { border-radius:1px; } </style><div data-caption-color="" data-size-tablet="" data-size-mobile="" data-align="center" data-tablet-image-separate="false" data-mobile-image-separate="false" class="zpimage-container zpimage-align-center zpimage-size-fit zpimage-tablet-fallback-fit zpimage-mobile-fallback-fit hb-lightbox " data-lightbox-options="
                type:fullscreen,
                theme:dark"><figure role="none" class="zpimage-data-ref"><span class="zpimage-anchor" role="link" tabindex="0" aria-label="Open Lightbox" style="cursor:pointer;"><picture><img class="zpimage zpimage-style-none zpimage-space-none " src="https://blog.icefire.ca/SharePoint-classic-view-PointFire-blog.png" width="415" height="264.73" loading="lazy" size="fit" data-lightbox="true"></picture></span></figure></div>
</div><div data-element-id="elm_UG0gJDcZr6HFfH-RYKY51A" data-element-type="text" class="zpelement zpelem-text "><style> [data-element-id="elm_UG0gJDcZr6HFfH-RYKY51A"].zpelem-text{ border-radius:1px; } </style><div class="zptext zptext-align-left " data-editor="true"><p><br></p><div style="color:inherit;"><p><span style="font-size:16px;">For some apps “From your organization”, particularly the ones using the Add-in model in my case, there are some “You can’t add this app here” messages.</span></p><p style="font-size:11pt;"><br></p></div>
</div></div><div data-element-id="elm_Bt2BZK1l9J_KQT1I28pWVw" data-element-type="image" class="zpelement zpelem-image "><style> @media (min-width: 992px) { [data-element-id="elm_Bt2BZK1l9J_KQT1I28pWVw"] .zpimage-container figure img { width: 188px !important ; height: 212px !important ; } } @media (max-width: 991px) and (min-width: 768px) { [data-element-id="elm_Bt2BZK1l9J_KQT1I28pWVw"] .zpimage-container figure img { width:188px ; height:212px ; } } @media (max-width: 767px) { [data-element-id="elm_Bt2BZK1l9J_KQT1I28pWVw"] .zpimage-container figure img { width:188px ; height:212px ; } } [data-element-id="elm_Bt2BZK1l9J_KQT1I28pWVw"].zpelem-image { border-radius:1px; } </style><div data-caption-color="" data-size-tablet="" data-size-mobile="" data-align="left" data-tablet-image-separate="false" data-mobile-image-separate="false" class="zpimage-container zpimage-align-left zpimage-size-original zpimage-tablet-fallback-original zpimage-mobile-fallback-original hb-lightbox " data-lightbox-options="
                type:fullscreen,
                theme:dark"><figure role="none" class="zpimage-data-ref"><span class="zpimage-anchor" role="link" tabindex="0" aria-label="Open Lightbox" style="cursor:pointer;"><picture><img class="zpimage zpimage-style-none zpimage-space-none " src="https://blog.icefire.ca/SharePoint-cant-add-app-PointFire-blog.png" width="188" height="212" loading="lazy" size="original" data-lightbox="true"></picture></span></figure></div>
</div><div data-element-id="elm_A5hN2tbQKqs_NFmUKZ6PFQ" data-element-type="text" class="zpelement zpelem-text "><style> [data-element-id="elm_A5hN2tbQKqs_NFmUKZ6PFQ"].zpelem-text{ border-radius:1px; } </style><div class="zptext zptext-align-left " data-editor="true"><div style="color:inherit;"><p><span style="font-size:16px;"><br></span></p><p><span style="font-size:16px;">Usually “Find out why” is not that helpful, but for one such app, it gives an actual reason</span></p><p><br></p></div>
</div></div><div data-element-id="elm_naxVafU-4TI_NBFngZzw2A" data-element-type="image" class="zpelement zpelem-image "><style> @media (min-width: 992px) { [data-element-id="elm_naxVafU-4TI_NBFngZzw2A"] .zpimage-container figure img { width: 424px !important ; height: 260px !important ; } } @media (max-width: 991px) and (min-width: 768px) { [data-element-id="elm_naxVafU-4TI_NBFngZzw2A"] .zpimage-container figure img { width:424px ; height:260px ; } } @media (max-width: 767px) { [data-element-id="elm_naxVafU-4TI_NBFngZzw2A"] .zpimage-container figure img { width:424px ; height:260px ; } } [data-element-id="elm_naxVafU-4TI_NBFngZzw2A"].zpelem-image { border-radius:1px; } </style><div data-caption-color="" data-size-tablet="" data-size-mobile="" data-align="left" data-tablet-image-separate="false" data-mobile-image-separate="false" class="zpimage-container zpimage-align-left zpimage-size-original zpimage-tablet-fallback-original zpimage-mobile-fallback-original hb-lightbox " data-lightbox-options="
                type:fullscreen,
                theme:dark"><figure role="none" class="zpimage-data-ref"><span class="zpimage-anchor" role="link" tabindex="0" aria-label="Open Lightbox" style="cursor:pointer;"><picture><img class="zpimage zpimage-style-none zpimage-space-none " src="https://blog.icefire.ca/SharePoint-cant-add-app2-PointFire-blog.png" width="424" height="260" loading="lazy" size="original" data-lightbox="true"></picture></span></figure></div>
</div><div data-element-id="elm_JDMp-10cKYpFz-KlQMylsg" data-element-type="text" class="zpelement zpelem-text "><style> [data-element-id="elm_JDMp-10cKYpFz-KlQMylsg"].zpelem-text{ border-radius:1px; } </style><div class="zptext zptext-align-left " data-editor="true"><div style="color:inherit;"><div style="color:inherit;"><p><span style="font-size:16px;"><br></span></p><p><span style="font-size:16px;">Something something taxonomy, yada yada.&nbsp; There are a couple of taxonomy-related hidden features on SharePoint sites.&nbsp; A little digging and it looks like feature with ID 73EF14B1-13A9-416b-A9B5-ECECA2B0604C is not enabled on Private Channel sites, but is enabled on other sites.&nbsp; Try this command to turn it back on:</span></p><p><span style="font-size:16px;"><br></span></p><p><span style="font-size:16px;">Enable-PnPFeature 73EF14B1-13A9-416b-A9B5-ECECA2B0604C -Scope Site -Force</span></p><p><span style="font-size:16px;">That did it for me, suddenly there were 20 options of apps that could be added, including Calendar, Tasks, Promoted Links, Surveys, all the good classic SharePoint stuff, plus most of my custom apps.&nbsp; It works for me, it might work for you.</span></p><p><span style="font-size:16px;"><br></span></p><p>Did you find this article useful? Have questions? Let us know in the comments.</p><p style="font-size:11pt;"><br></p></div>
</div></div></div></div></div></div></div></div>]]></content:encoded><pubDate>Thu, 27 Apr 2023 13:20:08 -0400</pubDate></item><item><title><![CDATA[Multilingual proofing of SharePoint pages]]></title><link>https://blog.icefire.ca/blogs/post/multilingual-proofing-of-sharepoint-pages</link><description><![CDATA[<img align="left" hspace="5" src="https://blog.icefire.ca/PointFire-blog-SharePoint-multilingual-proofing-4.png"/>Microsoft was rolled out Multilingual proofing for SharePoint. We take a deep dive into its capabilities and limitations.]]></description><content:encoded><![CDATA[<div class="zpcontent-container blogpost-container "><div data-element-id="elm_coBEfdG2TIeY6mTKiMQRAw" data-element-type="section" class="zpsection "><style type="text/css"></style><div class="zpcontainer-fluid zpcontainer"><div data-element-id="elm_fx6aJOOnRSuL-mrH132s7A" data-element-type="row" class="zprow zprow-container zpalign-items- zpjustify-content- " data-equal-column=""><style type="text/css"> [data-element-id="elm_fx6aJOOnRSuL-mrH132s7A"].zprow{ border-radius:1px; } </style><div data-element-id="elm_D95NntH7Ss-qkSXyLcvZdQ" data-element-type="column" class="zpelem-col zpcol-12 zpcol-md-12 zpcol-sm-12 zpalign-self- "><style type="text/css"></style><div data-element-id="elm_qOJ77SI_QR-_NcPLx40UzQ" data-element-type="text" class="zpelement zpelem-text "><style> [data-element-id="elm_qOJ77SI_QR-_NcPLx40UzQ"].zpelem-text{ border-radius:1px; } </style><div class="zptext zptext-align-center " data-editor="true"><div style="color:inherit;"><div style="color:inherit;"><p style="text-align:left;">We saw in April 2022, when SharePoint introduced the <a href="/Category-blog#/blogs/post/sharepoint-microsoft-editor-how-to-overcome-language-issues" title="Microsoft editor to the SharePoint page editing" rel="">Microsoft edit</a><a href="/Category-blog#/blogs/post/sharepoint-microsoft-editor-how-to-overcome-language-issues" title="Microsoft editor to the SharePoint page editing" rel="">or to the SharePoint page editing</a> experience, that it was not able to detect the language of the text, so it would often fill the screen with red squiggles when there was a different language.&nbsp; Luckily, by popular demand a few weeks later they rolled out a way to turn it off.&nbsp; But as of a few weeks ago, language detection is here.&nbsp; Multilingual proofing for SharePoint editing has been rolled out.</p><p style="text-align:left;"><span style="font-size:16px;"><br></span></p><p style="text-align:left;"><span style="font-size:16px;">Now it is possible to have proofing in several languages at once, as you see in this picture</span></p><p style="text-align:left;"><span style="font-size:16px;"><br></span></p></div>
</div></div></div><div data-element-id="elm_Ei5Po4Up05Ar7NMALt5Cvg" data-element-type="image" class="zpelement zpelem-image "><style> @media (min-width: 992px) { [data-element-id="elm_Ei5Po4Up05Ar7NMALt5Cvg"] .zpimage-container figure img { width: 796px !important ; height: 400px !important ; } } @media (max-width: 991px) and (min-width: 768px) { [data-element-id="elm_Ei5Po4Up05Ar7NMALt5Cvg"] .zpimage-container figure img { width:796px ; height:400px ; } } @media (max-width: 767px) { [data-element-id="elm_Ei5Po4Up05Ar7NMALt5Cvg"] .zpimage-container figure img { width:796px ; height:400px ; } } [data-element-id="elm_Ei5Po4Up05Ar7NMALt5Cvg"].zpelem-image { border-radius:1px; } </style><div data-caption-color="" data-size-tablet="" data-size-mobile="" data-align="left" data-tablet-image-separate="false" data-mobile-image-separate="false" class="zpimage-container zpimage-align-left zpimage-size-original zpimage-tablet-fallback-original zpimage-mobile-fallback-original hb-lightbox " data-lightbox-options="
                type:fullscreen,
                theme:dark"><figure role="none" class="zpimage-data-ref"><span class="zpimage-anchor" role="link" tabindex="0" aria-label="Open Lightbox" style="cursor:pointer;"><picture><img class="zpimage zpimage-style-none zpimage-space-none " src="https://blog.icefire.ca/PointFire-blog-SharePoint-multilingual-proofing-1.png" width="796" height="400" loading="lazy" size="original" data-lightbox="true"></picture></span></figure></div>
</div><div data-element-id="elm_vVFCt60eIgW03fPlnBWGaQ" data-element-type="text" class="zpelement zpelem-text "><style> [data-element-id="elm_vVFCt60eIgW03fPlnBWGaQ"].zpelem-text{ border-radius:1px; } </style><div class="zptext zptext-align-left " data-editor="true"><div style="color:inherit;"><div style="color:inherit;"><p><span style="font-size:16px;"><br></span></p><p><span style="font-size:16px;">As you can see it correctly picked up typos in the English text, in the French text and in the German text, but it does not do the Portuguese text, it put squiggles under each of those words.</span></p><p><span style="font-size:16px;">&nbsp;</span></p><p><span style="font-size:16px;">How did I configure it to get those results?&nbsp; First let’s look at the announcement in the admin centre’s Message Centre.</span></p><p><span style="font-size:16px;"><br></span></p></div>
</div></div></div><div data-element-id="elm_H5BAPpGEqxTdqsFkq5P4ow" data-element-type="image" class="zpelement zpelem-image "><style> @media (min-width: 992px) { [data-element-id="elm_H5BAPpGEqxTdqsFkq5P4ow"] .zpimage-container figure img { width: 560px !important ; height: 502px !important ; } } @media (max-width: 991px) and (min-width: 768px) { [data-element-id="elm_H5BAPpGEqxTdqsFkq5P4ow"] .zpimage-container figure img { width:560px ; height:502px ; } } @media (max-width: 767px) { [data-element-id="elm_H5BAPpGEqxTdqsFkq5P4ow"] .zpimage-container figure img { width:560px ; height:502px ; } } [data-element-id="elm_H5BAPpGEqxTdqsFkq5P4ow"].zpelem-image { border-radius:1px; } </style><div data-caption-color="" data-size-tablet="" data-size-mobile="" data-align="left" data-tablet-image-separate="false" data-mobile-image-separate="false" class="zpimage-container zpimage-align-left zpimage-size-original zpimage-tablet-fallback-original zpimage-mobile-fallback-original hb-lightbox " data-lightbox-options="
                type:fullscreen,
                theme:dark"><figure role="none" class="zpimage-data-ref"><span class="zpimage-anchor" role="link" tabindex="0" aria-label="Open Lightbox" style="cursor:pointer;"><picture><img class="zpimage zpimage-style-none zpimage-space-none " src="https://blog.icefire.ca/PointFire-blog-SharePoint-multilingual-proofing-2.png" width="560" height="502" loading="lazy" size="original" data-lightbox="true"></picture></span></figure></div>
</div><div data-element-id="elm_BgtYRLCN-iEbwOMhVJfP-Q" data-element-type="text" class="zpelement zpelem-text "><style> [data-element-id="elm_BgtYRLCN-iEbwOMhVJfP-Q"].zpelem-text{ border-radius:1px; } </style><div class="zptext zptext-align-left " data-editor="true"><div style="color:inherit;"><div style="color:inherit;"><p><span><br></span></p><p><span style="font-size:16px;">It’s not much to go on, but further down it also says this: “The Microsoft Editor Spellchecker, now integrated in SharePoint pages, will now be able to proof text in multiple languages. In addition to supporting the Page language, Editor now proofs in the M365 language and the Edge browser language. Any word in any of these three languages, will be spell checked appropriately. ”</span></p><p><span style="font-size:16px;"><br></span></p><p><span style="font-size:16px;"></span></p><div style="color:inherit;"><p><span style="font-size:16px;">What are these three languages?&nbsp; It refers to the “Page language”.&nbsp; The page language usually means the base language of the site, but if you have the multilingual page publishing feature activated, it can also mean the language of the copied page that is created for you to translate.&nbsp; It also refers to “the M365 language”, and it is a bit mistaken about that.&nbsp; What it actually means is the Office 365 <u>profile</u> language, which is not necessarily the same as the Microsoft 365 <u>account</u> language.&nbsp; The other one is the “Edge browser language”.&nbsp; Of course it doesn’t have to be Edge, all browsers have the ability to list the languages that you have configured the browser for.</span></p><p><span style="font-size:16px;"><br></span></p><p><span style="font-size:16px;">Let’s test the feature.&nbsp; First, I turned off Chrome’s own spell checking and confirmed which language the browser was configured for.&nbsp; Edge and other browsers all have similar settings.</span></p><p><span><br></span></p></div>
</div></div></div></div><div data-element-id="elm_dw7QP2fT0mRoHP0Iy6vwFA" data-element-type="image" class="zpelement zpelem-image "><style> @media (min-width: 992px) { [data-element-id="elm_dw7QP2fT0mRoHP0Iy6vwFA"] .zpimage-container figure img { width: 1064px !important ; height: 616px !important ; } } @media (max-width: 991px) and (min-width: 768px) { [data-element-id="elm_dw7QP2fT0mRoHP0Iy6vwFA"] .zpimage-container figure img { width:1064px ; height:616px ; } } @media (max-width: 767px) { [data-element-id="elm_dw7QP2fT0mRoHP0Iy6vwFA"] .zpimage-container figure img { width:1064px ; height:616px ; } } [data-element-id="elm_dw7QP2fT0mRoHP0Iy6vwFA"].zpelem-image { border-radius:1px; } </style><div data-caption-color="" data-size-tablet="" data-size-mobile="" data-align="left" data-tablet-image-separate="false" data-mobile-image-separate="false" class="zpimage-container zpimage-align-left zpimage-size-original zpimage-tablet-fallback-original zpimage-mobile-fallback-original hb-lightbox " data-lightbox-options="
                type:fullscreen,
                theme:dark"><figure role="none" class="zpimage-data-ref"><span class="zpimage-anchor" role="link" tabindex="0" aria-label="Open Lightbox" style="cursor:pointer;"><picture><img class="zpimage zpimage-style-none zpimage-space-none " src="https://blog.icefire.ca/PointFire-blog-SharePoint-multilingual-proofing-3.png" width="1064" height="616" loading="lazy" size="original" data-lightbox="true"></picture></span></figure></div>
</div><div data-element-id="elm_03UjbvshxZhJTZQM_bIifA" data-element-type="text" class="zpelement zpelem-text "><style> [data-element-id="elm_03UjbvshxZhJTZQM_bIifA"].zpelem-text{ border-radius:1px; } </style><div class="zptext zptext-align-left " data-editor="true"><div style="color:inherit;"><div style="color:inherit;"><p><span style="font-size:16px;"><br></span></p><p><span style="font-size:16px;">In this case I have configured Chrome for three versions of English, one version of French, and one version of German, so three languages altogether excluding the variants.&nbsp; I also turned off the spell checking.</span></p><p><span style="font-size:16px;"><br></span></p><p><span style="font-size:16px;">Next, I turned off the Microsoft Editor browser add-in, whose settings would supersede the simpler version of Microsoft Editor that is built into SharePoint. Lastly, I turned the Editor feature back on, which I had turned off when that setting had become available, by pressing on “Page details” and turning on the “Use Editor” setting.</span></p><p><span style="font-size:16px;"><br></span></p></div>
</div></div></div><div data-element-id="elm_AgNvG7G9vO85hgLuga0EnQ" data-element-type="image" class="zpelement zpelem-image "><style> @media (min-width: 992px) { [data-element-id="elm_AgNvG7G9vO85hgLuga0EnQ"] .zpimage-container figure img { width: 1048px !important ; height: 478px !important ; } } @media (max-width: 991px) and (min-width: 768px) { [data-element-id="elm_AgNvG7G9vO85hgLuga0EnQ"] .zpimage-container figure img { width:1048px ; height:478px ; } } @media (max-width: 767px) { [data-element-id="elm_AgNvG7G9vO85hgLuga0EnQ"] .zpimage-container figure img { width:1048px ; height:478px ; } } [data-element-id="elm_AgNvG7G9vO85hgLuga0EnQ"].zpelem-image { border-radius:1px; } </style><div data-caption-color="" data-size-tablet="" data-size-mobile="" data-align="left" data-tablet-image-separate="false" data-mobile-image-separate="false" class="zpimage-container zpimage-align-left zpimage-size-original zpimage-tablet-fallback-original zpimage-mobile-fallback-original hb-lightbox " data-lightbox-options="
                type:fullscreen,
                theme:dark"><figure role="none" class="zpimage-data-ref"><span class="zpimage-anchor" role="link" tabindex="0" aria-label="Open Lightbox" style="cursor:pointer;"><picture><img class="zpimage zpimage-style-none zpimage-space-none " src="https://blog.icefire.ca/PointFire-blog-SharePoint-multilingual-proofing-4.png" width="1048" height="478" loading="lazy" size="original" data-lightbox="true"></picture></span></figure></div>
</div><div data-element-id="elm_XzqO6lPFBi6D4oZVRw2zrg" data-element-type="text" class="zpelement zpelem-text "><style> [data-element-id="elm_XzqO6lPFBi6D4oZVRw2zrg"].zpelem-text{ border-radius:1px; } </style><div class="zptext zptext-align-left " data-editor="true"><div style="color:inherit;"><div style="color:inherit;"><p><span style="font-size:16px;"><br></span></p><p><span style="font-size:16px;">Now it finds typos in English, French and German, but not in Portuguese.</span></p><p><span style="font-size:16px;">Next, I added some Spanish text and then changed my Office 365 <u>profile</u> language to Spanish but not my Microsoft 365 <u>account</u> language.&nbsp;&nbsp;</span></p><p><span style="font-size:16px;"><br></span></p><p><span style="font-size:16px;">It then happily spell-checked the Spanish text.</span></p><p><span style="font-size:16px;"><br></span></p></div>
</div></div></div><div data-element-id="elm_FAy-LdQl5Aecy3sfgtylJQ" data-element-type="image" class="zpelement zpelem-image "><style> @media (min-width: 992px) { [data-element-id="elm_FAy-LdQl5Aecy3sfgtylJQ"] .zpimage-container figure img { width: 560px !important ; height: 404px !important ; } } @media (max-width: 991px) and (min-width: 768px) { [data-element-id="elm_FAy-LdQl5Aecy3sfgtylJQ"] .zpimage-container figure img { width:560px ; height:404px ; } } @media (max-width: 767px) { [data-element-id="elm_FAy-LdQl5Aecy3sfgtylJQ"] .zpimage-container figure img { width:560px ; height:404px ; } } [data-element-id="elm_FAy-LdQl5Aecy3sfgtylJQ"].zpelem-image { border-radius:1px; } </style><div data-caption-color="" data-size-tablet="" data-size-mobile="" data-align="left" data-tablet-image-separate="false" data-mobile-image-separate="false" class="zpimage-container zpimage-align-left zpimage-size-original zpimage-tablet-fallback-original zpimage-mobile-fallback-original hb-lightbox " data-lightbox-options="
                type:fullscreen,
                theme:dark"><figure role="none" class="zpimage-data-ref"><span class="zpimage-anchor" role="link" tabindex="0" aria-label="Open Lightbox" style="cursor:pointer;"><picture><img class="zpimage zpimage-style-none zpimage-space-none " src="https://blog.icefire.ca/PointFire-blog-SharePoint-multilingual-proofing-5.png" width="560" height="404" loading="lazy" size="original" data-lightbox="true"></picture></span></figure></div>
</div><div data-element-id="elm_3VtgyQrm5dA3B1BVwHRFpQ" data-element-type="text" class="zpelement zpelem-text "><style> [data-element-id="elm_3VtgyQrm5dA3B1BVwHRFpQ"].zpelem-text{ border-radius:1px; } </style><div class="zptext zptext-align-left " data-editor="true"><div style="color:inherit;"><p><span style="font-size:16px;"><br></span></p><p><span style="font-size:16px;">Maybe the combination of Spanish and Portuguese isn’t the greatest example given that some words appear in both languages, but the perfectly correct Portuguese word “revisão” is not recognized.&nbsp; When we click on the word to find spelling suggestions, it suggests words in English, Spanish, French, and German, notice the two-letter language codes, but not in Portuguese.</span></p><p><span style="font-size:16px;"><br></span></p></div>
</div></div><div data-element-id="elm_HqWmh8sDlneu4uzVUMPM2w" data-element-type="image" class="zpelement zpelem-image "><style> @media (min-width: 992px) { [data-element-id="elm_HqWmh8sDlneu4uzVUMPM2w"] .zpimage-container figure img { width: 322px !important ; height: 448px !important ; } } @media (max-width: 991px) and (min-width: 768px) { [data-element-id="elm_HqWmh8sDlneu4uzVUMPM2w"] .zpimage-container figure img { width:322px ; height:448px ; } } @media (max-width: 767px) { [data-element-id="elm_HqWmh8sDlneu4uzVUMPM2w"] .zpimage-container figure img { width:322px ; height:448px ; } } [data-element-id="elm_HqWmh8sDlneu4uzVUMPM2w"].zpelem-image { border-radius:1px; } </style><div data-caption-color="" data-size-tablet="" data-size-mobile="" data-align="left" data-tablet-image-separate="false" data-mobile-image-separate="false" class="zpimage-container zpimage-align-left zpimage-size-original zpimage-tablet-fallback-original zpimage-mobile-fallback-original hb-lightbox " data-lightbox-options="
                type:fullscreen,
                theme:dark"><figure role="none" class="zpimage-data-ref"><span class="zpimage-anchor" role="link" tabindex="0" aria-label="Open Lightbox" style="cursor:pointer;"><picture><img class="zpimage zpimage-style-none zpimage-space-none " src="https://blog.icefire.ca/PointFire-blog-SharePoint-multilingual-proofing-6.png" width="322" height="448" loading="lazy" size="original" data-lightbox="true"></picture></span></figure></div>
</div><div data-element-id="elm_bml4_MkDRGOrISwvtOs82A" data-element-type="text" class="zpelement zpelem-text "><style> [data-element-id="elm_bml4_MkDRGOrISwvtOs82A"].zpelem-text{ border-radius:1px; } </style><div class="zptext zptext-align-left " data-editor="true"><div style="color:inherit;"><div style="color:inherit;"><p><span style="font-size:16px;">One thing that is interesting about this is that, based on the announcement, on similarities with the Microsoft Editor browser extension, and on sneaking a peek at the code, it theoretically should only support up to three languages.&nbsp; In actual fact, it supports as many languages as I tried.&nbsp; I did notice that when you have more than one language, it stops checking for grammar or syntax as well as it does with a single language.</span></p><p><span style="font-size:16px;"><br></span></p><p><span style="font-size:16px;">This is a significant improvement in the editing experience for people with multilingual sites, so if you had turned off the Editor feature, now is the time to turn it back on.</span></p><p><span style="font-size:16px;"><br></span></p><p><span style="font-size:16px;">I hope you found this article helpful. Feel free to leave me your questions in the comments.</span></p></div>
</div></div></div><div data-element-id="elm_3s9lOkkDfmU0L3Y6tyRMuA" data-element-type="divider" class="zpelement zpelem-divider "><style type="text/css"> [data-element-id="elm_3s9lOkkDfmU0L3Y6tyRMuA"].zpelem-divider{ border-radius:1px; } </style><style></style><div class="zpdivider-container zpdivider-line zpdivider-align-center zpdivider-width100 zpdivider-line-style-solid " data-divider-border-color><div class="zpdivider-common"></div>
</div></div><div data-element-id="elm_07zHL4OqD0xQ2Lx7eZQyGQ" data-element-type="text" class="zpelement zpelem-text "><style> [data-element-id="elm_07zHL4OqD0xQ2Lx7eZQyGQ"].zpelem-text{ border-radius:1px; } </style><div class="zptext zptext-align-left " data-editor="true"><p><span style="font-weight:700;">You might also like</span></p><p><span style="font-weight:700;"><br></span></p><p><span style="font-weight:400;"><a href="https://sitebuilder-751082542.zohositescontent.com/blogs/post/localizing-group-by-headers-for-choice-columns-using-json-view-formatting" rel="">Localizing "group by" headers for choice columns using JSON view formatting in SharePoint Online</a></span></p><p><br></p><p><a href="https://sitebuilder-751082542.zohositescontent.com/blogs/post/language-dependent-json-column-formatting-this-time-it-s-the-uilcid-token" title="Language-dependent JSON column formatting, this time it's the IIlcid token" rel="">Language-dependent JSON column formatting, this time it's the IIlcid token</a></p></div>
</div></div></div></div></div></div>]]></content:encoded><pubDate>Mon, 27 Mar 2023 11:54:56 -0400</pubDate></item><item><title><![CDATA[Localizing "group by" headers for choice columns using JSON view formatting in SharePoint Online]]></title><link>https://blog.icefire.ca/blogs/post/localizing-group-by-headers-for-choice-columns-using-json-view-formatting</link><description><![CDATA[<img align="left" hspace="5" src="https://blog.icefire.ca/SharePoint-group-by-list.png"/>In previous posts, I’ve shown how Choice column values can be localized using a variety of techniques in JSON column formatting, most notably by using the “@UIlcid” token. Can these techniques also be used when doing “group by” these choice columns? Let's find out]]></description><content:encoded><![CDATA[<div class="zpcontent-container blogpost-container "><div data-element-id="elm_8Hi9fVIMRPy3Dbr7T70kFQ" data-element-type="section" class="zpsection "><style type="text/css"></style><div class="zpcontainer-fluid zpcontainer"><div data-element-id="elm_trb5cnV-TK-bwzsxa1zMhQ" data-element-type="row" class="zprow zprow-container zpalign-items- zpjustify-content- " data-equal-column=""><style type="text/css"></style><div data-element-id="elm_cgjCOgfjRdSH7sSKTMofcg" data-element-type="column" class="zpelem-col zpcol-12 zpcol-md-12 zpcol-sm-12 zpalign-self- "><style type="text/css"></style><div data-element-id="elm_N2N7e5Q4QWS0SPMHavxDzQ" data-element-type="text" class="zpelement zpelem-text "><style> [data-element-id="elm_N2N7e5Q4QWS0SPMHavxDzQ"].zpelem-text{ border-radius:1px; } </style><div class="zptext zptext-align-center " data-editor="true"><div style="color:inherit;"><div style="color:inherit;"><p style="text-align:left;"><a href="https://blog.icefire.ca/blogs/post/language-dependent-json-column-formatting-this-time-it-s-the-uilcid-token" title="In previous posts" rel="">I</a><a href="https://blog.icefire.ca/blogs/post/language-dependent-json-column-formatting-this-time-it-s-the-uilcid-token" title="In previous posts" rel="">n previous posts</a>, I’ve shown how Choice column values can be localized using a variety of techniques in JSON column formatting, most notably by using the “@UIlcid” token.</p><p style="text-align:left;"><span style="font-size:16px;"><br></span></p><p style="text-align:left;"><span style="font-size:16px;">Can these techniques also be used when doing “group by” these choice columns?&nbsp; The short answer is no. &nbsp;But fear not, a design decision in SharePoint that normally breaks localization can be used to enable localization.</span></p><p style="text-align:left;"><span style="font-size:16px;"><br></span></p><p style="text-align:left;"><span style="font-size:16px;">Let’s have a look at what happens when we see a list that is “grouped by” a choice column.&nbsp; Here it is in English, grouped by “progress”:</span></p><p style="text-align:left;"><span style="font-size:16px;"><br></span></p></div>
</div></div></div><div data-element-id="elm_xgFvJtzhINNQQGDYZ0HLIQ" data-element-type="image" class="zpelement zpelem-image "><style> @media (min-width: 992px) { [data-element-id="elm_xgFvJtzhINNQQGDYZ0HLIQ"] .zpimage-container figure img { width: 939px !important ; height: 274px !important ; } } @media (max-width: 991px) and (min-width: 768px) { [data-element-id="elm_xgFvJtzhINNQQGDYZ0HLIQ"] .zpimage-container figure img { width:939px ; height:274px ; } } @media (max-width: 767px) { [data-element-id="elm_xgFvJtzhINNQQGDYZ0HLIQ"] .zpimage-container figure img { width:939px ; height:274px ; } } [data-element-id="elm_xgFvJtzhINNQQGDYZ0HLIQ"].zpelem-image { border-radius:1px; } </style><div data-caption-color="" data-size-tablet="" data-size-mobile="" data-align="left" data-tablet-image-separate="false" data-mobile-image-separate="false" class="zpimage-container zpimage-align-left zpimage-size-original zpimage-tablet-fallback-original zpimage-mobile-fallback-original hb-lightbox " data-lightbox-options="
                type:fullscreen,
                theme:dark"><figure role="none" class="zpimage-data-ref"><span class="zpimage-anchor" role="link" tabindex="0" aria-label="Open Lightbox" style="cursor:pointer;"><picture><img class="zpimage zpimage-style-none zpimage-space-none " src="https://blog.icefire.ca/SharePoint-group-by-list-1.png" width="939" height="274" loading="lazy" size="original" data-lightbox="true"></picture></span></figure></div>
</div><div data-element-id="elm_gB8t60afrizuegagyVWwNw" data-element-type="text" class="zpelement zpelem-text "><style> [data-element-id="elm_gB8t60afrizuegagyVWwNw"].zpelem-text{ border-radius:1px; } </style><div class="zptext zptext-align-left " data-editor="true"><div style="color:inherit;"><p><br></p><p>We have applied the technique from the <a href="https://blog.icefire.ca/blogs/post/language-dependent-json-column-formatting-this-time-it-s-the-uilcid-token" target="_blank" rel="">Language-dependent JSON column formatting</a> blog post so that the choice column values are localized into French and German.&nbsp; However as we can see below, this does not extend to the “group by” headers, those remain in English.&nbsp; The column value, in blue, is localized, but the same value in the header is not.</p><p><br></p></div>
</div></div><div data-element-id="elm_HTbeLRkTlKbZGCyikmquaQ" data-element-type="image" class="zpelement zpelem-image "><style> @media (min-width: 992px) { [data-element-id="elm_HTbeLRkTlKbZGCyikmquaQ"] .zpimage-container figure img { width: 930px !important ; height: 274px !important ; } } @media (max-width: 991px) and (min-width: 768px) { [data-element-id="elm_HTbeLRkTlKbZGCyikmquaQ"] .zpimage-container figure img { width:930px ; height:274px ; } } @media (max-width: 767px) { [data-element-id="elm_HTbeLRkTlKbZGCyikmquaQ"] .zpimage-container figure img { width:930px ; height:274px ; } } [data-element-id="elm_HTbeLRkTlKbZGCyikmquaQ"].zpelem-image { border-radius:1px; } </style><div data-caption-color="" data-size-tablet="" data-size-mobile="" data-align="left" data-tablet-image-separate="false" data-mobile-image-separate="false" class="zpimage-container zpimage-align-left zpimage-size-original zpimage-tablet-fallback-original zpimage-mobile-fallback-original hb-lightbox " data-lightbox-options="
                type:fullscreen,
                theme:dark"><figure role="none" class="zpimage-data-ref"><span class="zpimage-anchor" role="link" tabindex="0" aria-label="Open Lightbox" style="cursor:pointer;"><picture><img class="zpimage zpimage-style-none zpimage-space-none " src="https://blog.icefire.ca/SharePoint-group-by-list-2.png" width="930" height="274" loading="lazy" size="original" data-lightbox="true"></picture></span></figure></div>
</div><div data-element-id="elm_v1VTCDF-2BjGCou1WWf4JQ" data-element-type="text" class="zpelement zpelem-text "><style> [data-element-id="elm_v1VTCDF-2BjGCou1WWf4JQ"].zpelem-text{ border-radius:1px; } </style><div class="zptext zptext-align-left " data-editor="true"><div style="color:inherit;"><p><span style="font-size:16px;"><br></span></p><p><span style="font-size:16px;">The display of values in the columns can be customized by <u>column</u> formatting JSON, but display of values in the group-by headers must be customized by <u>view</u> formatting JSON.&nbsp; Let’s have a look at how we can change that formatting.&nbsp; In the View menu, we can find “Format current view” in the bottom.&nbsp; In this case we are going to format the AllItems (default) list view.</span></p><p><span style="font-size:16px;"><br></span></p></div>
</div></div><div data-element-id="elm_EtrHntJXQjsva6_ZgJxznQ" data-element-type="image" class="zpelement zpelem-image "><style> @media (min-width: 992px) { [data-element-id="elm_EtrHntJXQjsva6_ZgJxznQ"] .zpimage-container figure img { width: 392px ; height: 500.00px ; } } @media (max-width: 991px) and (min-width: 768px) { [data-element-id="elm_EtrHntJXQjsva6_ZgJxznQ"] .zpimage-container figure img { width:392px ; height:500.00px ; } } @media (max-width: 767px) { [data-element-id="elm_EtrHntJXQjsva6_ZgJxznQ"] .zpimage-container figure img { width:392px ; height:500.00px ; } } [data-element-id="elm_EtrHntJXQjsva6_ZgJxznQ"].zpelem-image { border-radius:1px; } </style><div data-caption-color="" data-size-tablet="" data-size-mobile="" data-align="left" data-tablet-image-separate="false" data-mobile-image-separate="false" class="zpimage-container zpimage-align-left zpimage-size-medium zpimage-tablet-fallback-medium zpimage-mobile-fallback-medium hb-lightbox " data-lightbox-options="
                type:fullscreen,
                theme:dark"><figure role="none" class="zpimage-data-ref"><span class="zpimage-anchor" role="link" tabindex="0" aria-label="Open Lightbox" style="cursor:pointer;"><picture><img class="zpimage zpimage-style-none zpimage-space-none " src="https://blog.icefire.ca/SharePoint-all-item-column-list-view.png" width="392" height="500.00" loading="lazy" size="medium" data-lightbox="true"></picture></span></figure></div>
</div><div data-element-id="elm_WjlFIifaH4mZT_ZZh8H6mg" data-element-type="text" class="zpelement zpelem-text "><style> [data-element-id="elm_WjlFIifaH4mZT_ZZh8H6mg"].zpelem-text{ border-radius:1px; } </style><div class="zptext zptext-align-left " data-editor="true"><div style="color:inherit;"><p><span style="font-size:16px;">By default it offers the graphical “design mode”.</span></p></div>
</div></div><div data-element-id="elm_rsFaz4wvHvffqKbNFQ0ZHA" data-element-type="image" class="zpelement zpelem-image "><style> @media (min-width: 992px) { [data-element-id="elm_rsFaz4wvHvffqKbNFQ0ZHA"] .zpimage-container figure img { width: 624px ; height: 760.00px ; } } @media (max-width: 991px) and (min-width: 768px) { [data-element-id="elm_rsFaz4wvHvffqKbNFQ0ZHA"] .zpimage-container figure img { width:500px ; height:608.97px ; } } @media (max-width: 767px) { [data-element-id="elm_rsFaz4wvHvffqKbNFQ0ZHA"] .zpimage-container figure img { width:500px ; height:608.97px ; } } [data-element-id="elm_rsFaz4wvHvffqKbNFQ0ZHA"].zpelem-image { border-radius:1px; } </style><div data-caption-color="" data-size-tablet="" data-size-mobile="" data-align="left" data-tablet-image-separate="false" data-mobile-image-separate="false" class="zpimage-container zpimage-align-left zpimage-size-large zpimage-tablet-fallback-large zpimage-mobile-fallback-large hb-lightbox " data-lightbox-options="
                type:fullscreen,
                theme:dark"><figure role="none" class="zpimage-data-ref"><span class="zpimage-anchor" role="link" tabindex="0" aria-label="Open Lightbox" style="cursor:pointer;"><picture><img class="zpimage zpimage-style-none zpimage-space-none " src="https://blog.icefire.ca/SharePoint-List-Format-view.png" width="500" height="608.97" loading="lazy" size="large" data-lightbox="true"></picture></span></figure></div>
</div><div data-element-id="elm_aHtGg_JUoG80LF7XPUEC-Q" data-element-type="text" class="zpelement zpelem-text "><style> [data-element-id="elm_aHtGg_JUoG80LF7XPUEC-Q"].zpelem-text{ border-radius:1px; } </style><div class="zptext zptext-align-left " data-editor="true"><div style="color:inherit;"><p><span style="font-size:16px;"><br></span></p><p><span style="font-size:16px;">Let’s select “Advanced mode” to see the JSON.&nbsp; It is initially empty other than the schema declaration, so it uses some default formatting.</span></p><p><span style="font-size:16px;"><br></span></p></div>
</div></div><div data-element-id="elm_4V-igUMwiOJko8r83KxGXQ" data-element-type="image" class="zpelement zpelem-image "><style> @media (min-width: 992px) { [data-element-id="elm_4V-igUMwiOJko8r83KxGXQ"] .zpimage-container figure img { width: 500px ; height: 610.58px ; } } @media (max-width: 991px) and (min-width: 768px) { [data-element-id="elm_4V-igUMwiOJko8r83KxGXQ"] .zpimage-container figure img { width:500px ; height:610.58px ; } } @media (max-width: 767px) { [data-element-id="elm_4V-igUMwiOJko8r83KxGXQ"] .zpimage-container figure img { width:500px ; height:610.58px ; } } [data-element-id="elm_4V-igUMwiOJko8r83KxGXQ"].zpelem-image { border-radius:1px; } </style><div data-caption-color="" data-size-tablet="" data-size-mobile="" data-align="left" data-tablet-image-separate="false" data-mobile-image-separate="false" class="zpimage-container zpimage-align-left zpimage-size-medium zpimage-tablet-fallback-medium zpimage-mobile-fallback-medium hb-lightbox " data-lightbox-options="
                type:fullscreen,
                theme:dark"><figure role="none" class="zpimage-data-ref"><span class="zpimage-anchor" role="link" tabindex="0" aria-label="Open Lightbox" style="cursor:pointer;"><picture><img class="zpimage zpimage-style-none zpimage-space-none " src="https://blog.icefire.ca/SharePoint-list-format-view-2.png" width="500" height="610.58" loading="lazy" size="medium" data-lightbox="true"></picture></span></figure></div>
</div><div data-element-id="elm_TdEEhbc7o53tz3OCqvDUxA" data-element-type="text" class="zpelement zpelem-text "><style> [data-element-id="elm_TdEEhbc7o53tz3OCqvDUxA"].zpelem-text{ border-radius:1px; } </style><div class="zptext zptext-align-left " data-editor="true"><div style="color:inherit;"><div style="color:inherit;"><p><span style="font-size:16px;"><br></span></p><p><span style="font-size:16px;">There are relatively few examples or information on what to do next, but we will add a minimalist formatting skeleton.&nbsp; The syntax is described here <a href="https://learn.microsoft.com/en-us/sharepoint/dev/declarative-customization/view-group-formatting">https://learn.microsoft.com/en-us/sharepoint/dev/declarative-customization/view-group-formatting</a></span></p><p><span style="font-size:16px;">The “group by” headers are within “headerFormatter” within “groupProps”.</span></p><p><span style="font-size:16px;"><br></span></p></div>
</div></div></div><div data-element-id="elm_wPIvwZraWJdJCP5ZN-k-hA" data-element-type="image" class="zpelement zpelem-image "><style> @media (min-width: 992px) { [data-element-id="elm_wPIvwZraWJdJCP5ZN-k-hA"] .zpimage-container figure img { width: 624px !important ; height: 204px !important ; } } @media (max-width: 991px) and (min-width: 768px) { [data-element-id="elm_wPIvwZraWJdJCP5ZN-k-hA"] .zpimage-container figure img { width:624px ; height:204px ; } } @media (max-width: 767px) { [data-element-id="elm_wPIvwZraWJdJCP5ZN-k-hA"] .zpimage-container figure img { width:624px ; height:204px ; } } [data-element-id="elm_wPIvwZraWJdJCP5ZN-k-hA"].zpelem-image { border-radius:1px; } </style><div data-caption-color="" data-size-tablet="" data-size-mobile="" data-align="left" data-tablet-image-separate="false" data-mobile-image-separate="false" class="zpimage-container zpimage-align-left zpimage-size-original zpimage-tablet-fallback-original zpimage-mobile-fallback-original hb-lightbox " data-lightbox-options="
                type:fullscreen,
                theme:dark"><figure role="none" class="zpimage-data-ref"><span class="zpimage-anchor" role="link" tabindex="0" aria-label="Open Lightbox" style="cursor:pointer;"><picture><img class="zpimage zpimage-style-none zpimage-space-none " src="https://blog.icefire.ca/SharePoint-list-header-formatter.png" width="624" height="204" loading="lazy" size="original" data-lightbox="true"></picture></span></figure></div>
</div><div data-element-id="elm_ibmSA-gbwnjsJyi9ckY_1w" data-element-type="text" class="zpelement zpelem-text "><style> [data-element-id="elm_ibmSA-gbwnjsJyi9ckY_1w"].zpelem-text{ border-radius:1px; } </style><div class="zptext zptext-align-left " data-editor="true"><div style="color:inherit;"><div style="color:inherit;"><p><span style="font-size:16px;"><br></span></p><p><span style="font-size:16px;">The syntax for “headerFormatter” is identical to that of column format, with the important caveat that a lot of it, despite correct syntax, does not work.&nbsp; Yes, there is a “txtContent”, but things like “@currentField” and “[$FieldName]” are not defined and most special strings, most notably "@UIlcid", are not available.</span></p><p><span style="font-size:16px;"><br></span></p><p><span style="font-size:16px;">That makes determining the language and formatting the value depending on the language difficult, because all of the techniques discussed in previous posts are not available.</span></p><p><span style="font-size:16px;"><br></span></p><p><span style="font-size:16px;">What is available is "@group", which has three properties,&nbsp; "fieldData", "columnDisplayName", and "count".&nbsp; Normally the use of column display names rather than internal names is a mistake.&nbsp; If you rely on it then things will break badly (like they do for list form JSON formatting) when you change the language, but in this case, that unfortunate design decision can be used to our advantage.</span></p><p><span style="font-size:16px;"><br></span></p><p><span style="font-size:16px;">In this case we have already localized the column names by entering the translations in the MUI (Multilingual User Interface)&nbsp; That means that the “Progress” column has a column display name of “Progress” in English, “Progrès” in French, and “Fortschritt” in German.&nbsp; The value of “@group.columnDisplayName” therefore tells us what is the current UI language, as long as the column header has been localized and its name is different in different languages.</span></p><p><span style="font-size:16px;"><br></span></p><p><span style="font-size:16px;">If we display the value of “@group.columnDisplayName” and of “@group.fieldData” in English we get this:</span></p><p><span style="font-size:16px;"><br></span></p></div>
</div></div></div><div data-element-id="elm_Bfj2YhXZNSw2U-G4islnNQ" data-element-type="image" class="zpelement zpelem-image "><style> @media (min-width: 992px) { [data-element-id="elm_Bfj2YhXZNSw2U-G4islnNQ"] .zpimage-container figure img { width: 624px !important ; height: 214px !important ; } } @media (max-width: 991px) and (min-width: 768px) { [data-element-id="elm_Bfj2YhXZNSw2U-G4islnNQ"] .zpimage-container figure img { width:624px ; height:214px ; } } @media (max-width: 767px) { [data-element-id="elm_Bfj2YhXZNSw2U-G4islnNQ"] .zpimage-container figure img { width:624px ; height:214px ; } } [data-element-id="elm_Bfj2YhXZNSw2U-G4islnNQ"].zpelem-image { border-radius:1px; } </style><div data-caption-color="" data-size-tablet="" data-size-mobile="" data-align="left" data-tablet-image-separate="false" data-mobile-image-separate="false" class="zpimage-container zpimage-align-left zpimage-size-original zpimage-tablet-fallback-original zpimage-mobile-fallback-original hb-lightbox " data-lightbox-options="
                type:fullscreen,
                theme:dark"><figure role="none" class="zpimage-data-ref"><span class="zpimage-anchor" role="link" tabindex="0" aria-label="Open Lightbox" style="cursor:pointer;"><picture><img class="zpimage zpimage-style-none zpimage-space-none " src="https://blog.icefire.ca/SharePoint-List-View-Format-3.png" width="624" height="214" loading="lazy" size="original" data-lightbox="true"></picture></span></figure></div>
</div><div data-element-id="elm_ED9PeQNDb-pmhox_wCEzVg" data-element-type="text" class="zpelement zpelem-text "><style> [data-element-id="elm_ED9PeQNDb-pmhox_wCEzVg"].zpelem-text{ border-radius:1px; } </style><div class="zptext zptext-align-left " data-editor="true"><div style="color:inherit;"><p><span style="font-size:16px;"><br></span></p><p><span style="font-size:16px;">We see “Progress=New application” But in French we get “Progrès=New application”</span></p><p><span style="font-size:16px;"><br></span></p></div>
</div></div><div data-element-id="elm_7w2z_fECcm5xtqHpoD3kWA" data-element-type="image" class="zpelement zpelem-image "><style> @media (min-width: 992px) { [data-element-id="elm_7w2z_fECcm5xtqHpoD3kWA"] .zpimage-container figure img { width: 624px !important ; height: 220px !important ; } } @media (max-width: 991px) and (min-width: 768px) { [data-element-id="elm_7w2z_fECcm5xtqHpoD3kWA"] .zpimage-container figure img { width:624px ; height:220px ; } } @media (max-width: 767px) { [data-element-id="elm_7w2z_fECcm5xtqHpoD3kWA"] .zpimage-container figure img { width:624px ; height:220px ; } } [data-element-id="elm_7w2z_fECcm5xtqHpoD3kWA"].zpelem-image { border-radius:1px; } </style><div data-caption-color="" data-size-tablet="" data-size-mobile="" data-align="left" data-tablet-image-separate="false" data-mobile-image-separate="false" class="zpimage-container zpimage-align-left zpimage-size-original zpimage-tablet-fallback-original zpimage-mobile-fallback-original hb-lightbox " data-lightbox-options="
                type:fullscreen,
                theme:dark"><figure role="none" class="zpimage-data-ref"><span class="zpimage-anchor" role="link" tabindex="0" aria-label="Open Lightbox" style="cursor:pointer;"><picture><img class="zpimage zpimage-style-none zpimage-space-none " src="https://blog.icefire.ca/SharePoint-List-View-Format-3-french.png" width="624" height="220" loading="lazy" size="original" data-lightbox="true"></picture></span></figure></div>
</div><div data-element-id="elm_DupHYuOueDSwXatq9KZQCQ" data-element-type="text" class="zpelement zpelem-text "><style> [data-element-id="elm_DupHYuOueDSwXatq9KZQCQ"].zpelem-text{ border-radius:1px; } </style><div class="zptext zptext-align-left " data-editor="true"><div style="color:inherit;"><p><span style="font-size:16px;"><br></span></p><p><span style="font-size:16px;">The “columnDisplayName” is localized by the MUI, but the column value is not localized by our column formatting.&nbsp; We can put this all together to take advantage of the display names.&nbsp; In the nested ifs below, we check the value of “@group.columnDisplayName” to determine the current language, then the current value, and then display the appropriate translation of that value.</span></p><p><span style="font-size:16px;"><br></span></p></div>
</div></div><div data-element-id="elm_JTDW_BnYzKN1MhT3o1ltZw" data-element-type="image" class="zpelement zpelem-image "><style> @media (min-width: 992px) { [data-element-id="elm_JTDW_BnYzKN1MhT3o1ltZw"] .zpimage-container figure img { width: 520px !important ; height: 424px !important ; } } @media (max-width: 991px) and (min-width: 768px) { [data-element-id="elm_JTDW_BnYzKN1MhT3o1ltZw"] .zpimage-container figure img { width:520px ; height:424px ; } } @media (max-width: 767px) { [data-element-id="elm_JTDW_BnYzKN1MhT3o1ltZw"] .zpimage-container figure img { width:520px ; height:424px ; } } [data-element-id="elm_JTDW_BnYzKN1MhT3o1ltZw"].zpelem-image { border-radius:1px; } </style><div data-caption-color="" data-size-tablet="" data-size-mobile="" data-align="left" data-tablet-image-separate="false" data-mobile-image-separate="false" class="zpimage-container zpimage-align-left zpimage-size-original zpimage-tablet-fallback-original zpimage-mobile-fallback-original hb-lightbox " data-lightbox-options="
                type:fullscreen,
                theme:dark"><figure role="none" class="zpimage-data-ref"><span class="zpimage-anchor" role="link" tabindex="0" aria-label="Open Lightbox" style="cursor:pointer;"><picture><img class="zpimage zpimage-style-none zpimage-space-none " src="https://blog.icefire.ca/SharePoint-list-groupcolumndisplayname.png" width="520" height="424" loading="lazy" size="original" data-lightbox="true"></picture></span></figure></div>
</div><div data-element-id="elm_O1jFViZbg1drbickBDRcBw" data-element-type="text" class="zpelement zpelem-text "><style> [data-element-id="elm_O1jFViZbg1drbickBDRcBw"].zpelem-text{ border-radius:1px; } </style><div class="zptext zptext-align-left " data-editor="true"><div style="color:inherit;"><p><span style="font-size:16px;"><br></span></p><p><span style="font-size:16px;">Here is the result, in French</span></p><p><span style="font-size:16px;"><br></span></p></div>
</div></div><div data-element-id="elm_KxtPeFV7WzUiR4fcmPgRig" data-element-type="image" class="zpelement zpelem-image "><style> @media (min-width: 992px) { [data-element-id="elm_KxtPeFV7WzUiR4fcmPgRig"] .zpimage-container figure img { width: 624px !important ; height: 180px !important ; } } @media (max-width: 991px) and (min-width: 768px) { [data-element-id="elm_KxtPeFV7WzUiR4fcmPgRig"] .zpimage-container figure img { width:624px ; height:180px ; } } @media (max-width: 767px) { [data-element-id="elm_KxtPeFV7WzUiR4fcmPgRig"] .zpimage-container figure img { width:624px ; height:180px ; } } [data-element-id="elm_KxtPeFV7WzUiR4fcmPgRig"].zpelem-image { border-radius:1px; } </style><div data-caption-color="" data-size-tablet="" data-size-mobile="" data-align="left" data-tablet-image-separate="false" data-mobile-image-separate="false" class="zpimage-container zpimage-align-left zpimage-size-original zpimage-tablet-fallback-original zpimage-mobile-fallback-original hb-lightbox " data-lightbox-options="
                type:fullscreen,
                theme:dark"><figure role="none" class="zpimage-data-ref"><span class="zpimage-anchor" role="link" tabindex="0" aria-label="Open Lightbox" style="cursor:pointer;"><picture><img class="zpimage zpimage-style-none zpimage-space-none " src="https://blog.icefire.ca/SharePoint-groupcolumndisplayname-french.png" width="624" height="180" loading="lazy" size="original" data-lightbox="true"></picture></span></figure></div>
</div><div data-element-id="elm_Zi7jj8fUNxAL4ftOkF7AIw" data-element-type="text" class="zpelement zpelem-text "><style> [data-element-id="elm_Zi7jj8fUNxAL4ftOkF7AIw"].zpelem-text{ border-radius:1px; } </style><div class="zptext zptext-align-left " data-editor="true"><div style="color:inherit;"><p><span style="font-size:16px;"><br></span></p><p><span style="font-size:16px;">And in German</span></p><p><span style="font-size:16px;"><br></span></p></div>
</div></div><div data-element-id="elm_sSKnDDx3neTPfQGWoE-8Og" data-element-type="image" class="zpelement zpelem-image "><style> @media (min-width: 992px) { [data-element-id="elm_sSKnDDx3neTPfQGWoE-8Og"] .zpimage-container figure img { width: 624px !important ; height: 182px !important ; } } @media (max-width: 991px) and (min-width: 768px) { [data-element-id="elm_sSKnDDx3neTPfQGWoE-8Og"] .zpimage-container figure img { width:624px ; height:182px ; } } @media (max-width: 767px) { [data-element-id="elm_sSKnDDx3neTPfQGWoE-8Og"] .zpimage-container figure img { width:624px ; height:182px ; } } [data-element-id="elm_sSKnDDx3neTPfQGWoE-8Og"].zpelem-image { border-radius:1px; } </style><div data-caption-color="" data-size-tablet="" data-size-mobile="" data-align="left" data-tablet-image-separate="false" data-mobile-image-separate="false" class="zpimage-container zpimage-align-left zpimage-size-original zpimage-tablet-fallback-original zpimage-mobile-fallback-original hb-lightbox " data-lightbox-options="
                type:fullscreen,
                theme:dark"><figure role="none" class="zpimage-data-ref"><span class="zpimage-anchor" role="link" tabindex="0" aria-label="Open Lightbox" style="cursor:pointer;"><picture><img class="zpimage zpimage-style-none zpimage-space-none " src="https://blog.icefire.ca/SharePoint-groupcolumndisplayname-german.png" width="624" height="182" loading="lazy" size="original" data-lightbox="true"></picture></span></figure></div>
</div><div data-element-id="elm_tZfNHFK3Pn7SA5CQ4otM9g" data-element-type="text" class="zpelement zpelem-text "><style> [data-element-id="elm_tZfNHFK3Pn7SA5CQ4otM9g"].zpelem-text{ border-radius:1px; } </style><div class="zptext zptext-align-left " data-editor="true"><div style="color:inherit;"><div style="color:inherit;"><div style="color:inherit;"><div style="color:inherit;"><p><br></p><p>What if the user decides to group by Position, a different Choice column, rather than by Progress?&nbsp; There is only one view formatting JSON no matter what you group by, and only one “groupProps” and one “headerFormatter”.&nbsp; Luckily the value of “group.columnDisplayName” detects not only the language but also which column is being grouped by, so you can just extend the nested ifs and localize all the choice columns from the view in a single “txtContent” expression.</p><p><br></p><p>The technique of using of “group.columnDisplayName” works for “@group” within the “group by” header as shown above, but it will also work for “@columnAggregate” in the footer and for the “@aggregates” array elements where applicable, and it also works for Gallery view.</p><p><span style="font-weight:bold;"><br></span></p><p><span style="font-weight:bold;">Was this useful? Leave us your questions in the comments section below!</span></p></div>
</div></div></div></div></div><div data-element-id="elm_K3suObFtGo0asxARDVqCHw" data-element-type="divider" class="zpelement zpelem-divider "><style type="text/css"> [data-element-id="elm_K3suObFtGo0asxARDVqCHw"].zpelem-divider{ border-radius:1px; } </style><style></style><div class="zpdivider-container zpdivider-line zpdivider-align-center zpdivider-width100 zpdivider-line-style-solid " data-divider-border-color><div class="zpdivider-common"></div>
</div></div><div data-element-id="elm_9byRa4AaPkGjvrrkLJYgGw" data-element-type="heading" class="zpelement zpelem-heading "><style> [data-element-id="elm_9byRa4AaPkGjvrrkLJYgGw"].zpelem-heading { border-radius:1px; } </style><h2 class="zpheading zpheading-style-none zpheading-align-left " data-editor="true"><span style="font-family:&quot;Work Sans&quot;;font-size:16px;font-weight:700;color:rgb(11, 27, 45);">Related Posts</span><br></h2></div>
<div data-element-id="elm_kgdO1p9uCVzTeuWPSKQOBQ" data-element-type="text" class="zpelement zpelem-text "><style> [data-element-id="elm_kgdO1p9uCVzTeuWPSKQOBQ"].zpelem-text{ border-radius:1px; padding-block-start:0px; margin-block-start:-1px; } </style><div class="zptext zptext-align-left " data-editor="true"><div><h1><div style="color:inherit;"></div></h1><h1><span style="font-family:&quot;Work Sans&quot;;font-size:16px;"><a href="https://blog.icefire.ca/blogs/post/language-dependent-json-column-formatting-this-time-it-s-the-uilcid-token" title="Language-dependent JSON column formatting: this time it's the @UIlcid token" target="_blank" rel="">Language-dependent JSON column formatting: this time it's the @UIlcid token</a></span></h1><h1><span style="font-size:16px;font-family:&quot;Work Sans&quot;;color:rgb(11, 27, 45);"><a href="https://blog.icefire.ca/blogs/post/language-dependent-json-column-formatting-using-the-lcid-token" title="Language-dependent JSON column formatting using the @lcid token" target="_blank" rel="">Language-dependent JSON column formatting using the @lcid token</a></span></h1><div><div style="color:inherit;"><h1><span style="font-size:16px;font-family:&quot;Work Sans&quot;;"><a href="https://blog.icefire.ca/blogs/post/json-for-different-text-in-different-languages" target="_blank" rel="">JSON for different text in different languages</a></span></h1></div>
</div></div></div></div></div></div></div></div></div>]]></content:encoded><pubDate>Wed, 08 Mar 2023 11:47:08 -0500</pubDate></item><item><title><![CDATA[Language-dependent JSON column formatting: this time it's the @UIlcid token]]></title><link>https://blog.icefire.ca/blogs/post/language-dependent-json-column-formatting-this-time-it-s-the-uilcid-token</link><description><![CDATA[<img align="left" hspace="5" src="https://blog.icefire.ca/Fri Aug 26 2022-2.png"/>This seems to have become a series, as Microsoft adds features to SharePoint JSON formatting.&nbsp; The previous installment is here .&nbsp; A week ago ]]></description><content:encoded><![CDATA[<div class="zpcontent-container blogpost-container "><div data-element-id="elm_s9K0Z5y6SfunuB9WMlDwDw" data-element-type="section" class="zpsection "><style type="text/css"></style><div class="zpcontainer-fluid zpcontainer"><div data-element-id="elm_SIBF4NPBRoaaMbW8OMWbJQ" data-element-type="row" class="zprow zprow-container zpalign-items- zpjustify-content- " data-equal-column=""><style type="text/css"></style><div data-element-id="elm_kOK6NuRXT4-WuwhumdTDAw" data-element-type="column" class="zpelem-col zpcol-12 zpcol-md-12 zpcol-sm-12 zpalign-self- "><style type="text/css"></style><div data-element-id="elm_5oRnlVMnSuKj3K0jKDMzvQ" data-element-type="text" class="zpelement zpelem-text "><style> [data-element-id="elm_5oRnlVMnSuKj3K0jKDMzvQ"].zpelem-text{ border-radius:1px; } </style><div class="zptext zptext-align-left " data-editor="true"><p>This seems to have become a series, as Microsoft adds features to SharePoint JSON formatting.&nbsp; The previous installment is <a href="/index#https%3A//blog.icefire.ca/blogs/post/language-dependent-json-column-formatting-using-the-lcid-token" title="here" rel="">here</a>.&nbsp; A week ago, Microsoft released a new @UIlcid token, which corrects the problem that I discussed in the previous post.&nbsp; This time, this token is the actual current language of the site, unlike the @lcid token that was available before.<br><br> So unlike the earlier post (<a href="/index#https%3A//blog.icefire.ca/blogs/post/language-dependent-json-column-formatting-using-the-lcid-token" title="read it now" rel="">read it now</a>) using "@UIlcid" rather than "@lcid" resolves all the issues about matching the Language and the Locale.&nbsp; The example is very similar to the previous post, and the effect is the same, just use&nbsp;<span style="color:inherit;">"@UIlcid" (Note: it's case-sensitive) rather than "@lcid" and you can replace the display of field values including choice columns with the translation without changing the value that is stored.</span><br><span style="color:inherit;"><img src="https://blog.icefire.ca/Fri%20Aug%2026%202022.png" alt=""></span><br></p><p><span style="color:inherit;"><br></span></p><p><span style="color:inherit;">Does it apply to other places where the value appears?&nbsp; Yes!&nbsp; Well, most of the time.&nbsp; Does it work in "new" and "edit" panes?&nbsp; Yes!&nbsp; Below, both the selected and unselected values are translated.</span></p><p><span style="color:inherit;"><img src="https://blog.icefire.ca/Fri%20Aug%2026%202022-1.png" alt=""></span><span style="color:inherit;"><br></span></p><p><span style="color:inherit;">Does it work for "Type to filter"?&nbsp; No.&nbsp; The filtering mechanism knows nothing about the translations.&nbsp; For that you would need to use multilingual managed metadata instead; it knows about translated values and can filter by them, and now column formatting works on that field type.</span></p><p><span style="color:inherit;"><br></span></p><p><span style="color:inherit;">Does it work in grid view?&nbsp; Yes it does!</span></p><p><span style="color:inherit;"><img src="https://blog.icefire.ca/Fri%20Aug%2026%202022-2.png" alt=""></span><span style="color:inherit;"><br></span></p><p><span style="color:inherit;"><br></span></p><p><span style="color:inherit;">Does it work with Multi-select choice fields?&nbsp; No, but it could with a little extra effort.&nbsp; You would simply have to <a href="/index#https%3A//docs.microsoft.com/en-us/sharepoint/dev/declarative-customization/column-formatting%23simple-html-elements-formatting" title="use forEach and loopIndex" rel="">use <span style="font-family:&quot;Courier New&quot;, monospace;">forEach</span> and <span style="font-family:&quot;Courier New&quot;, monospace;">loopIndex</span></a>&nbsp;to go through the values and translate them individually, selected or not.</span></p><p><span style="color:inherit;"><br></span></p><p><span style="color:inherit;">As you may have guessed, automatically translating choice columns is an upcoming feature of PointFire 365, with lookup columns to follow.</span></p><p><span style="color:inherit;"><br></span></p><p><span style="color:inherit;"><br></span></p></div>
</div><div data-element-id="elm_rAkbVdurb5dippRX321gnw" data-element-type="text" class="zpelement zpelem-text "><style> [data-element-id="elm_rAkbVdurb5dippRX321gnw"].zpelem-text{ border-radius:1px; } </style><div class="zptext zptext-align-left " data-editor="true"><p><span style="font-weight:700;">Related Posts</span></p><div style="color:inherit;"><h1><div style="color:inherit;"></div></h1><h1><span style="font-family:&quot;Work Sans&quot;;font-size:16px;"><a href="https://blog.icefire.ca/blogs/post/localizing-group-by-headers-for-choice-columns-using-json-view-formatting" target="_blank" rel="">Localizing "group by" headers for choice columns using JSON view formatting in SharePoint Online</a></span></h1><h1><span style="font-size:16px;font-family:&quot;Work Sans&quot;;"><a href="https://blog.icefire.ca/blogs/post/language-dependent-json-column-formatting-using-the-lcid-token" target="_blank" rel="">Language-dependent JSON column formatting using the @lcid token</a></span></h1><div><h1><span style="font-size:16px;font-family:&quot;Work Sans&quot;;"><a href="https://blog.icefire.ca/blogs/post/json-for-different-text-in-different-languages" target="_blank" rel="">JSON for different text in different languages</a></span></h1></div>
</div></div></div></div></div></div></div></div>]]></content:encoded><pubDate>Fri, 26 Aug 2022 16:11:46 -0400</pubDate></item><item><title><![CDATA[How to get a higher level of machine translation quality]]></title><link>https://blog.icefire.ca/blogs/post/how-to-get-a-higher-level-of-machine-translation-quality</link><description><![CDATA[<img align="left" hspace="5" src="https://blog.icefire.ca/Z-code-model-improvement.png"/>What can you do to ensure the highest level of quality in Machine Translation of pages and documents in Microsoft SharePoint? This blog post details all the steps to follow and different problems and their solutions]]></description><content:encoded><![CDATA[<div class="zpcontent-container blogpost-container "><div data-element-id="elm_AjkHLZCBQ-iNaI_HQ5KNSw" data-element-type="section" class="zpsection "><style type="text/css"></style><div class="zpcontainer-fluid zpcontainer"><div data-element-id="elm_LKRYFxFTSZaqvDcBJt5BIg" data-element-type="row" class="zprow zprow-container zpalign-items- zpjustify-content- " data-equal-column=""><style type="text/css"></style><div data-element-id="elm_vL5D9nZ1S6SfIHmapowXZA" data-element-type="column" class="zpelem-col zpcol-12 zpcol-md-12 zpcol-sm-12 zpalign-self- "><style type="text/css"></style><div data-element-id="elm_bFHzWy19Tt-eRiB1PPc9PQ" data-element-type="text" class="zpelement zpelem-text "><style></style><div class="zptext zptext-align-center " data-editor="true"><div style="color:inherit;"><div style="color:inherit;"><p style="text-align:left;"><span style="font-size:16px;">Clients often ask me what they can do to ensure the highest level of quality in Machine Translation of pages and documents.&nbsp; This blog post applies particularly to users of PointFire Translator, but since the translation technology that we use is similar to that of other products that follow the leading edge of machine translation technology, most of the advice below applies to other machine translation scenarios.&nbsp; If you are using the machine translation of PointFire on premise or SharePoint on premise, that is much older technology, and the advice would be a bit different.</span></p><p style="text-align:left;font-size:11pt;"><br></p><p style="text-align:left;"><span style="font-size:16px;">The first thing that you need to do is determine your tolerance for errors in different types of documents and the time and money you are willing to spend to correct the errors.&nbsp; Not all documents need to be translated with the same level of quality.&nbsp; Some of them are fine if you get the gist, while others must be very faithful to the original.</span></p><p style="text-align:left;font-size:11pt;"><br></p><p style="text-align:left;"><span style="font-size:16px;">A good human translator will charge about 10-50 cents per word depending on the languages and the type of text.&nbsp; Azure Translator text API will charge about 0.02 cents per word, Azure Translator document API will charge about 0.04 cents and Azure Custom translator will charge 0.1 cents.&nbsp; These are round figures, but the cost savings from machine translation is considerable.</span></p><p style="text-align:left;font-size:11pt;"><br></p><p style="text-align:left;"><span style="font-size:16px;">How accurate are the translations from machine translation?&nbsp; That is a complex subject, but in the past decade we have gone from statistical machine translation which was still barely better than gibberish except for languages from the same family, to the current situation where translation for many language pairs including English to Chinese and back, has reached what is called ”human parity”, to the next generation of machine translation based on Z-code MoE models (more on that below), with dramatic improvements in many language pairs.</span></p></div>
</div></div></div><div data-element-id="elm_r2KnMymHcmv4TCkr0ahWYg" data-element-type="heading" class="zpelement zpelem-heading "><style> [data-element-id="elm_r2KnMymHcmv4TCkr0ahWYg"].zpelem-heading { border-radius:1px; } </style><h2 class="zpheading zpheading-style-none zpheading-align-left " data-editor="true"><span style="font-family:&quot;Work Sans&quot;;font-size:20px;font-weight:700;color:rgb(11, 27, 45);">What does "human parity" mean?</span><br></h2></div>
<div data-element-id="elm_O_PakDiCy0zZw1xOa7r8ww" data-element-type="text" class="zpelement zpelem-text "><style> [data-element-id="elm_O_PakDiCy0zZw1xOa7r8ww"].zpelem-text{ border-radius:1px; } </style><div class="zptext zptext-align-left " data-editor="true"><div style="color:inherit;"><p>Let us stand back and try to understand what the term “human parity” means and what it doesn’t.&nbsp;</p><p>First, the humans in question are not professional translators.&nbsp; Professional human translators are still better.&nbsp; The tests that justified the use of that term came from an annual competition where both humans and machines translated sentences from news stories.&nbsp; Journalistic style is relatively simple, and the machines had trained on other news stories, so that makes it easier.&nbsp; The two sets of translations, human and machine, were then scored independently for quality.&nbsp; Microsoft Azure Translator obtained as good a score as the average human.&nbsp; But remember, the humans in this comparison were probably bilingual computer science students, as were the evaluators.&nbsp; If the testing had been done with professional translators doing the translation and doing the rating, it would not have been a tie, as other studies have shown.&nbsp; “Human parity” is a good benchmark, but it is far from perfection.&nbsp; There are still errors.</p></div>
</div></div><div data-element-id="elm_t27sTJ2gip6GuGFciEXZAA" data-element-type="heading" class="zpelement zpelem-heading "><style> [data-element-id="elm_t27sTJ2gip6GuGFciEXZAA"].zpelem-heading { border-radius:1px; } </style><h2 class="zpheading zpheading-style-none zpheading-align-left " data-editor="true"><span style="font-family:&quot;Work Sans&quot;;font-weight:700;color:rgb(11, 27, 45);font-size:20px;">What are these human parity errors and what can we do about them?</span><br></h2></div>
<div data-element-id="elm_3ADNPzqpJYqFU8fVvYejTQ" data-element-type="text" class="zpelement zpelem-text "><style> [data-element-id="elm_3ADNPzqpJYqFU8fVvYejTQ"].zpelem-text{ border-radius:1px; } </style><div class="zptext zptext-align-left " data-editor="true"><div style="color:inherit;"><div style="color:inherit;"><p><span style="font-size:16px;">Different language pairs will have different types of errors.&nbsp; Again, depending on the types of errors you are getting and how badly you need to correct them, there are different things that you can do.&nbsp; Take negation errors for example.&nbsp; These are easily noticeable by users.&nbsp; A sentence that contains a negative in the source language may be incorrectly missing the negation in the target language, or vice-versa, or may have incorrect scoping: does the not/nicht/kein apply to one adjective, to the whole clause, or to the verb?&nbsp; Some languages handle negation differently, and it is not necessarily clear to the translation engine what is being negated.&nbsp; It is a particular problem between English and either Russian, Lithuanian, or German.&nbsp; Part of the reason is that training sets used to create and tune translation engines don't contain a lot of negation.</span></p><p><span style="font-size:16px;"><br></span></p><p><span style="font-size:16px;">Negation is only one category of errors among many others, but a very noticeable one.&nbsp; Linguistic and statistical measures of quality will say the translation is very, very close, it’s only off by one word, but the client will say not it’s not, it’s as wrong as it could be, it’s the opposite.&nbsp; It is a very simple error to correct, it requires very little editing time to change it.&nbsp; Humans and machines have very different evaluation criteria.</span></p><p><br></p></div>
</div></div></div><div data-element-id="elm_uJ16oPTKVh6tmjrZkMZ32g" data-element-type="heading" class="zpelement zpelem-heading "><style> [data-element-id="elm_uJ16oPTKVh6tmjrZkMZ32g"].zpelem-heading { border-radius:1px; } </style><h2 class="zpheading zpheading-style-none zpheading-align-left " data-editor="true"><div><p><span style="font-family:&quot;Work Sans&quot;;font-size:20px;font-weight:700;color:rgb(11, 27, 45);">Four things you can do to improve translation quality in general</span></p></div></h2></div>
<div data-element-id="elm_xx8Pxbuy6wb9y0ZIKV-qMg" data-element-type="text" class="zpelement zpelem-text "><style> [data-element-id="elm_xx8Pxbuy6wb9y0ZIKV-qMg"].zpelem-text{ border-radius:1px; } </style><div class="zptext zptext-align-left " data-editor="true"><div style="color:inherit;"><ol><li style="text-align:left;">Implement a&nbsp;<b>post-editing</b>&nbsp;step that looks particularly for certain kinds of common translation errors before publishing</li><li style="text-align:left;">Switch to&nbsp;<b>Azure Custom Translator</b>&nbsp;and train it on a corpus of your own documents and phrases so that it learns your vocabulary and your style</li><li style="text-align:left;">Participate in the by-invitation pilot of the&nbsp;<b>Z-Code MoE</b>&nbsp;translation engine</li><li style="text-align:left;">Change the&nbsp;<b>style guide of source documents</b>&nbsp;so that they are written in a way that is easier to translate</li></ol></div>
</div></div><div data-element-id="elm_KeCel1nQmnQ4vVLUeMUA-w" data-element-type="heading" class="zpelement zpelem-heading "><style> [data-element-id="elm_KeCel1nQmnQ4vVLUeMUA-w"].zpelem-heading { border-radius:1px; } </style><h2 class="zpheading zpheading-style-none zpheading-align-left " data-editor="true"><span style="font-family:&quot;Work Sans&quot;;font-size:16px;font-weight:700;color:rgb(11, 27, 45);"><span>1.</span>&nbsp;<b><span>Post editing</span></b></span><br></h2></div>
<div data-element-id="elm_6Hvk1SJb4Hu2Rra3s8f7UA" data-element-type="text" class="zpelement zpelem-text "><style> [data-element-id="elm_6Hvk1SJb4Hu2Rra3s8f7UA"].zpelem-text{ border-radius:1px; } </style><div class="zptext zptext-align-left " data-editor="true"><div style="color:inherit;"><div style="color:inherit;"><p><span style="font-size:16px;">Post editing is the simplest and most robust solution.&nbsp; It means making changes to the translated page or document.&nbsp; It should be implemented whether or not you implement some of the other solutions.&nbsp; Machine translation is not perfect, so <u>limited</u> post-editing is good practice.&nbsp; It is still significantly cheaper than professional translation or editing and may be cheaper than Azure Custom Translator.&nbsp; PointFire Translator by default saves all documents, pages, and items as drafts, and someone should revise that draft before it is published.&nbsp; This advice is not what most people want to hear, they want a technology solution because they don’t have the in-house expertise to translate, and would like the technology to solve the problem without involving them.&nbsp; Sorry.</span></p><p><span style="font-size:16px;"><br></span></p><p><span style="font-size:16px;text-decoration-line:underline;">Who should do this?</span></p><p><span style="font-size:16px;">The obvious answer may not be the best one.&nbsp; “We have someone in the office who speaks both languages”.&nbsp; No matter how clever they are, efficiently editing documents in their other language may not be in their skill set.&nbsp; And you have to make sure that someone’s ethnicity or cultural background does not mean that they get extra tasks that do not contribute to their career progression or career goals.</span></p><p><span style="font-size:16px;">What is this “limited editing” that I mentioned?&nbsp; That is actually very challenging even for professional editors and translators.&nbsp; You want to limit the time that is spent in this editing step, otherwise you will end up spending more on post-editing than you would have for professional translators.&nbsp; Remember, professional translators have access to machine translation too.&nbsp; Today’s translators are already only charging you for machine translation plus the cost of post-editing, and they are very good and quick at doing this.&nbsp; They have glossaries, translation memory databases, and previous translations at their fingertips and they do this all day. The cost advantage that you have over them comes from the fact that they’re perfectionists and you’re not.&nbsp;</span></p><p><span style="font-size:16px;"><br></span></p><p><span style="font-size:16px;">Limited post-editing means you correct some errors that are show stoppers and easy to correct, like negation errors, and let other errors slide.&nbsp; You find poor phrasing, not quite the right word, or errors in agreement between the noun and the adjective?&nbsp; These are errors that do not require reading the original text in a different language in order to correct, and everyone reading it knows what the author meant to say.&nbsp; And those errors are more time-consuming to correct.&nbsp; I know it’s hard to see an error on a page that you are editing and leave it there, and not everyone agrees with this advice, but this is how you control costs.&nbsp; Given the current quality of machine translation, for most documents you will not even hit the edit button, you will click on publish if you can resist the temptation to fiddle with the text until it’s perfect.&nbsp; Different types of documents require different edit rules. If the text is describing a procedure that must be exact, spend more time ensuring that it is exact.&nbsp; It’s like a food processing assembly line.&nbsp; There are some acceptable defects, but also some that cannot be tolerated no matter the cost.</span></p><p><span style="font-size:16px;"><br></span></p><p><span style="font-size:16px;">As we will see below, certain errors are difficult to prevent by other methods.&nbsp; Post editing is the best way to correct them, but if too much post-editing is required or too many errors are missed, professional translators may be a safer or less costly alternative.</span></p></div>
</div></div></div><div data-element-id="elm_7z63fPqCuIWe9VQM-lAlGw" data-element-type="heading" class="zpelement zpelem-heading "><style> [data-element-id="elm_7z63fPqCuIWe9VQM-lAlGw"].zpelem-heading { border-radius:1px; } </style><h2 class="zpheading zpheading-style-none zpheading-align-left " data-editor="true"><span style="color:rgb(11, 27, 45);font-family:&quot;Work Sans&quot;;font-size:16px;font-weight:700;">2. Custom Translator</span></h2></div>
<div data-element-id="elm_9Rd0WWQOyVmS-enwOTGzcg" data-element-type="text" class="zpelement zpelem-text "><style> [data-element-id="elm_9Rd0WWQOyVmS-enwOTGzcg"].zpelem-text{ border-radius:1px; } </style><div class="zptext zptext-align-left " data-editor="true"><div style="color:inherit;"><div style="color:inherit;"><p><span style="font-size:16px;">While Azure Translator uses the same translation engine for everyone, <u>Azure Custom Translator</u> is an alternative engine that you can re-train on your documents and vocabulary.&nbsp; It can increase translation accuracy by a few points, particularly for specialized domains.&nbsp; You’re in the automotive industry?&nbsp; Tell Custom Translator and your score will already improve over the default engine.</span></p><p><span style="font-size:16px;"><br></span></p><p><span style="font-size:16px;">Unfortunately, re-training a translation model, the main component of the translation engine, is not very simple and it requires some knowledge of linguistics and statistics, plus a lot of data and data cleaning, to get the advantage of having your own model.&nbsp; The new preview interface of Azure Custom Translator is a big improvement, but it still needs some work.&nbsp; I may blog more in the future about how to use it, but here is a brief introduction.</span></p></div>
</div></div></div><div data-element-id="elm_al7R8ERiPoaZm3Ox0k3YfQ" data-element-type="image" class="zpelement zpelem-image "><style> @media (min-width: 992px) { [data-element-id="elm_al7R8ERiPoaZm3Ox0k3YfQ"] .zpimage-container figure img { width: 606px !important ; height: 502px !important ; } } @media (max-width: 991px) and (min-width: 768px) { [data-element-id="elm_al7R8ERiPoaZm3Ox0k3YfQ"] .zpimage-container figure img { width:606px ; height:502px ; } } @media (max-width: 767px) { [data-element-id="elm_al7R8ERiPoaZm3Ox0k3YfQ"] .zpimage-container figure img { width:606px ; height:502px ; } } [data-element-id="elm_al7R8ERiPoaZm3Ox0k3YfQ"].zpelem-image { border-radius:1px; } </style><div data-caption-color="" data-size-tablet="" data-size-mobile="" data-align="left" data-tablet-image-separate="false" data-mobile-image-separate="false" class="zpimage-container zpimage-align-left zpimage-size-original zpimage-tablet-fallback-original zpimage-mobile-fallback-original hb-lightbox " data-lightbox-options="
                type:fullscreen,
                theme:dark"><figure role="none" class="zpimage-data-ref"><span class="zpimage-anchor" role="link" tabindex="0" aria-label="Open Lightbox" style="cursor:pointer;"><picture><img class="zpimage zpimage-style-none zpimage-space-none " src="https://blog.icefire.ca/Microsoft%20Azure%20Custom%20Translator.png" width="606" height="502" loading="lazy" size="original" data-lightbox="true"></picture></span></figure></div>
</div><div data-element-id="elm_Rw5kfiVGt5242iWqM0spQw" data-element-type="text" class="zpelement zpelem-text "><style> [data-element-id="elm_Rw5kfiVGt5242iWqM0spQw"].zpelem-text{ border-radius:1px; } </style><div class="zptext zptext-align-left " data-editor="true"><div style="color:inherit;"><p><span style="font-size:16px;">First you need to have at least 10,000 professionally translated sentences or terms, in a supported format and following the naming conventions.&nbsp; This is the learning set.&nbsp; You can upload parallel documents in both languages, and it has some tools to help you align the sentences, but it’s not as good as you’d think and you have to revise carefully.&nbsp; If an extra line is inserted, every sentence after that will be mis-aligned.&nbsp; You also have to remove the sentences that are not quite the same.&nbsp; Translators often split or combine sentences when they translate, it may be more natural sounding that way, but it will confuse the translation engine training, best to remove those.&nbsp; Similarly, some translations, although correct, are not a good example for a machine to train on. For example, if the text is talking about pangrams,&nbsp; sentences that use all 26 letters, “the quick brown fox jumped over the lazy dog” can be translated to “Portez ce vieux whisky au juge blond qui fume” (Carry this old whiskey to the blonde judge who smokes).&nbsp; While it’s correct in this context, having a model learn from this translation would probably interfere with the model’s ability to translate other text about canids.&nbsp; Training sets have to curated to be most effective.&nbsp; How about idioms, expressions that do not translate literally?&nbsp; Those are good, training sets should include them so that it will know later how to translate those in a way that is not literal.</span></p><p><span style="font-size:16px;"><br></span></p><div style="color:inherit;"><p><span>Besides those 10,000 sentence pairs, you will also need a testing set and a tuning set.&nbsp; To simplify the process a bit, neural network models train on a training set, but you also need a set of sentences to test on.&nbsp; If you over-train a neural network translation model, it will become very good with the sentences it has seen, but at some point it becomes worse at the sentences that it hasn’t seen.&nbsp; It is memorizing the training sentences, but not generalizing.&nbsp; You have to stop the training when it gets to the highest quality score, and before it gets worse.&nbsp; The measure of quality that it is optimizing is called the <a href="https://docs.microsoft.com/en-us/azure/cognitive-services/translator/custom-translator/what-is-bleu-score" title="BLEU score" target="_blank" rel="">BLEU score</a>.&nbsp; Again simplifying a bit, the BLEU score looks at the translation that the model produced and compares it to the translation that a professional translator provided. The score is a purely numerical comparison.&nbsp; For each sequence of 4 words in your translation, does that sequence of 4 words appear in the reference professional translation?&nbsp; How about for sequences of 3, 2, or 1 words?&nbsp; The score has other factors as well, but that is the essential.</span></p><p><span style="font-size:16px;text-decoration-line:underline;"><br></span></p><p></p><div style="color:inherit;"><div style="color:inherit;"><p><span style="font-size:16px;text-decoration-line:underline;">A couple of notes about the BLEU score:</span></p><ul><li><span>Professional translators don’t get perfect marks because one translator can phrase things differently from other translators.&nbsp; They will get maybe 50 out of 100.</span></li><li><span>BLEU score is not good at punishing long-range errors, things that are more than 4 words apart like negation for instance</span></li><li><span>It doesn’t care about meaning or synonyms. If you use the word “large” and the translator used the word “big”, you get the same score as if you had used “small” or even “but” or “blarg”</span></li></ul><div><div style="color:inherit;"><div style="color:inherit;"><p><span style="font-size:16px;"><br></span></p><p><span style="font-size:16px;">For better or for worse that score is what Azure Custom Translator is trying to maximize.&nbsp; It starts out with a good general model, and then it modifies it a using the training data that you provide.&nbsp; The “tuning set” of training data is especially crucial.&nbsp; It has to be very representative of the translations that you will carry out later, and a lot of the quality of the model depends on having the correct distribution of and range of documents in this set.</span></p><p><span style="font-size:16px;"><br></span></p><p><span style="font-size:16px;">How much more translation accuracy you can get by using Custom Translator depends on the language pair and on the type of text.&nbsp; For example, English-German already has very high translation quality without re-training, so the improvement may be smaller than other languages.&nbsp; Version 1 of Custom Translator improved the accuracy of English-German over the normal Azur Translator by a few points of BLEU score, much more in the automotive field with a medium number of documents. “Medium” in this case means 50-100 thousand professionally translated sentences.</span></p></div>
</div></div></div></div></div></div></div></div><div data-element-id="elm_7bhcNtLxLD5l9eR9tTdtCw" data-element-type="image" class="zpelement zpelem-image "><style> @media (min-width: 992px) { [data-element-id="elm_7bhcNtLxLD5l9eR9tTdtCw"] .zpimage-container figure img { width: 800px ; height: 390.24px ; } } @media (max-width: 991px) and (min-width: 768px) { [data-element-id="elm_7bhcNtLxLD5l9eR9tTdtCw"] .zpimage-container figure img { width:500px ; height:243.90px ; } } @media (max-width: 767px) { [data-element-id="elm_7bhcNtLxLD5l9eR9tTdtCw"] .zpimage-container figure img { width:500px ; height:243.90px ; } } [data-element-id="elm_7bhcNtLxLD5l9eR9tTdtCw"].zpelem-image { border-radius:1px; } </style><div data-caption-color="" data-size-tablet="" data-size-mobile="" data-align="left" data-tablet-image-separate="false" data-mobile-image-separate="false" class="zpimage-container zpimage-align-left zpimage-size-large zpimage-tablet-fallback-large zpimage-mobile-fallback-large hb-lightbox " data-lightbox-options="
                type:fullscreen,
                theme:dark"><figure role="none" class="zpimage-data-ref"><span class="zpimage-anchor" role="link" tabindex="0" aria-label="Open Lightbox" style="cursor:pointer;"><picture><img class="zpimage zpimage-style-none zpimage-space-none " src="https://blog.icefire.ca/Machine-translation-bleu-score.png" width="500" height="243.90" loading="lazy" size="large" data-lightbox="true"></picture></span></figure></div>
</div><div data-element-id="elm_TDYUdk6t8COGKQYMU2Q2Sw" data-element-type="text" class="zpelement zpelem-text "><style> [data-element-id="elm_TDYUdk6t8COGKQYMU2Q2Sw"].zpelem-text{ border-radius:1px; } </style><div class="zptext zptext-align-left " data-editor="true"><p><span style="color:inherit;">You can find more details <a href="https://www.microsoft.com/en-us/translator/blog/2018/05/07/customtranslator/" title="here" target="_blank" rel="">here</a></span><br></p><p><br></p><div style="color:inherit;"><p><span style="font-size:16px;">Version 2 of the Custom Translator, which includes “human parity” models that PointFire uses, improved even further particularly for languages where Version 1 had not performed as well like Korean and Hindi, although less so for languages where it was already good like German.</span></p></div>
</div></div><div data-element-id="elm_HCYIDBrOuHTLavvs39uS1g" data-element-type="image" class="zpelement zpelem-image "><style> @media (min-width: 992px) { [data-element-id="elm_HCYIDBrOuHTLavvs39uS1g"] .zpimage-container figure img { width: 800px ; height: 451.13px ; } } @media (max-width: 991px) and (min-width: 768px) { [data-element-id="elm_HCYIDBrOuHTLavvs39uS1g"] .zpimage-container figure img { width:500px ; height:281.95px ; } } @media (max-width: 767px) { [data-element-id="elm_HCYIDBrOuHTLavvs39uS1g"] .zpimage-container figure img { width:500px ; height:281.95px ; } } [data-element-id="elm_HCYIDBrOuHTLavvs39uS1g"].zpelem-image { border-radius:1px; } </style><div data-caption-color="" data-size-tablet="" data-size-mobile="" data-align="left" data-tablet-image-separate="false" data-mobile-image-separate="false" class="zpimage-container zpimage-align-left zpimage-size-large zpimage-tablet-fallback-large zpimage-mobile-fallback-large hb-lightbox " data-lightbox-options="
                type:fullscreen,
                theme:dark"><figure role="none" class="zpimage-data-ref"><span class="zpimage-anchor" role="link" tabindex="0" aria-label="Open Lightbox" style="cursor:pointer;"><picture><img class="zpimage zpimage-style-none zpimage-space-none " src="https://blog.icefire.ca/translator-human-parity-evaluation.png" width="500" height="281.95" loading="lazy" size="large" data-lightbox="true"></picture></span></figure></div>
</div><div data-element-id="elm_4DiNdbzmzranzhB7Auye1Q" data-element-type="text" class="zpelement zpelem-text "><style> [data-element-id="elm_4DiNdbzmzranzhB7Auye1Q"].zpelem-text{ border-radius:1px; } </style><div class="zptext zptext-align-left " data-editor="true"><p>More information <a href="https://www.microsoft.com/en-us/translator/blog/2020/08/05/custom-translator-v2-is-now-available/" title="here" target="_blank" rel="">here</a></p><p><br></p><div style="color:inherit;"><p><span style="font-size:16px;">Depending on the language and the field, particularly how your specialized vocabulary differs from the vocabulary that Microsoft used in its training, typically government documents crawled from the web, you can get small to significant improvements in translation quality by training your own model in Azure Custom Translator. However, it requires significant investment in time and resources to set up, and Microsoft charges 4-5 times what it charges for the regular translation engine.&nbsp; It is not for everyone.</span></p></div>
</div></div><div data-element-id="elm_SMVGEGtgKib5mh1B0WwI4g" data-element-type="heading" class="zpelement zpelem-heading "><style> [data-element-id="elm_SMVGEGtgKib5mh1B0WwI4g"].zpelem-heading { border-radius:1px; } </style><h2 class="zpheading zpheading-style-none zpheading-align-left " data-editor="true"><span style="font-family:&quot;Work Sans&quot;;font-size:16px;font-weight:700;color:rgb(11, 27, 45);"><span>3.</span>&nbsp;<b><span>Z-code MoE models</span></b></span><br></h2></div>
<div data-element-id="elm_QkyHWUBroZTYPmGc55bSAw" data-element-type="text" class="zpelement zpelem-text "><style> [data-element-id="elm_QkyHWUBroZTYPmGc55bSAw"].zpelem-text{ border-radius:1px; } </style><div class="zptext zptext-align-left " data-editor="true"><div style="color:inherit;"><p><span style="font-size:16px;">Z-code is part of Microsoft’s larger ambitious “XYZ-code” initiative.&nbsp; It takes advantage of new technology for massive, massive neural networks of a scale barely envisioned a few years ago, billions or even hundreds of billions of parameters, made possible with the Microsoft DeepSpeed library <a href="https://www.deepspeed.ai/">https://www.deepspeed.ai/</a>.&nbsp; It’s thousands of times bigger than current translation models.&nbsp; Rather than separately training individual models for English-French, English-Hungarian, English-Chinese, etc., it trains one massive model that learns about all language pairs at once.&nbsp; In order to avoid duplication, the model teaches itself about features that are common to families of languages, and features that are common to all written human languages.&nbsp; That way, even if it was not given enough examples from a particular language pair, it can extrapolate from examples in other related languages, and most likely get it right.&nbsp; It is called MoE (mixture of experts) because it incorporates specialized competing smaller models, called “experts”, each of which may propose an answer but each of which specializes in a type of problems, and it has another component that is trained to be good at determining which of the experts will be right under different circumstances.</span></p><p><span style="font-size:16px;"><br></span></p><p><span style="font-size:16px;"></span></p><div style="color:inherit;"><p><span style="font-size:16px;">Those engines went live in March 2022 and are available by invitation. &nbsp;They will probably be generally available some time next year. &nbsp;They are particularly good at languages for which there is a smaller training corpus, for example southern Slavic languages like Slovenian, Bosnian, and Bulgarian.&nbsp; If your language pair is among the ones that get a significant improvement in quality, it’s worth trying to get an invitation.&nbsp; At the moment, this can not be combined with Custom Translator.</span></p></div>
</div></div></div><div data-element-id="elm_zbYnt6IXGFBNDbX1lUkSEw" data-element-type="image" class="zpelement zpelem-image "><style> @media (min-width: 992px) { [data-element-id="elm_zbYnt6IXGFBNDbX1lUkSEw"] .zpimage-container figure img { width: 800px ; height: 448.95px ; } } @media (max-width: 991px) and (min-width: 768px) { [data-element-id="elm_zbYnt6IXGFBNDbX1lUkSEw"] .zpimage-container figure img { width:500px ; height:280.59px ; } } @media (max-width: 767px) { [data-element-id="elm_zbYnt6IXGFBNDbX1lUkSEw"] .zpimage-container figure img { width:500px ; height:280.59px ; } } [data-element-id="elm_zbYnt6IXGFBNDbX1lUkSEw"].zpelem-image { border-radius:1px; } </style><div data-caption-color="" data-size-tablet="" data-size-mobile="" data-align="left" data-tablet-image-separate="false" data-mobile-image-separate="false" class="zpimage-container zpimage-align-left zpimage-size-large zpimage-tablet-fallback-large zpimage-mobile-fallback-large hb-lightbox " data-lightbox-options="
                type:fullscreen,
                theme:dark"><figure role="none" class="zpimage-data-ref"><span class="zpimage-anchor" role="link" tabindex="0" aria-label="Open Lightbox" style="cursor:pointer;"><picture><img class="zpimage zpimage-style-none zpimage-space-none " src="https://blog.icefire.ca/Z-code-model-improvement.png" width="500" height="280.59" loading="lazy" size="large" data-lightbox="true"></picture></span><figcaption class="zpimage-caption zpimage-caption-align-left"><span class="zpimage-caption-content">https://www.microsoft.com/en-us/research/blog/microsoft-translator-enhanced-with-z-code-mixture-of-experts-models/</span></figcaption></figure></div>
</div><div data-element-id="elm_OQwd_SnAb6N02BZB_ruPHg" data-element-type="text" class="zpelement zpelem-text "><style> [data-element-id="elm_OQwd_SnAb6N02BZB_ruPHg"].zpelem-text{ border-radius:1px; } </style><div class="zptext zptext-align-left " data-editor="true"><div style="color:inherit;"><p><span style="font-size:16px;">In the diagram above, the percent improvement seems to be improvement in BLEU score.&nbsp; According to other research, this class of models is particularly good for correcting negation errors in German.&nbsp; Note that 2) and 3) cannot be used together.</span></p></div>
</div></div><div data-element-id="elm_7aVIN8NpeAfTGVU-IdT5tA" data-element-type="heading" class="zpelement zpelem-heading "><style> [data-element-id="elm_7aVIN8NpeAfTGVU-IdT5tA"].zpelem-heading { border-radius:1px; } </style><h2 class="zpheading zpheading-style-none zpheading-align-left " data-editor="true"><span style="font-family:&quot;Work Sans&quot;;font-size:16px;font-weight:700;color:rgb(11, 27, 45);">4.&nbsp;<b>Write the original with a style that is easier to translate</b></span><br></h2></div>
<div data-element-id="elm_vcQN4VKKdoH9ht-q7JII5Q" data-element-type="text" class="zpelement zpelem-text "><style> [data-element-id="elm_vcQN4VKKdoH9ht-q7JII5Q"].zpelem-text{ border-radius:1px; } </style><div class="zptext zptext-align-left " data-editor="true"><div style="color:inherit;"><div style="color:inherit;"><p><span style="font-size:16px;">This is a bit strange to say, but English is not a good source language to translate from.&nbsp; A lot of its grammar is vague or ambiguous.&nbsp; For example, it often recycles words to mean something else.&nbsp; Well known examples include “A good pharmacist dispenses with accuracy”. “Dispense” and “dispense with” are very different concepts that use the same words.&nbsp; It is obvious to humans from context, but how is a computer to know?&nbsp; “Bill gave the dog water and Sue the cat food”.&nbsp; Here the conjunction reuses the verb give, but the subject, direct object and indirect object require an educated guess. Is it a single object made up of one noun (cat) describing the other noun (food), or two different objects of the same verb?&nbsp; English does not have declensions and is stingy with the prepositions that other languages use to make such things clear.&nbsp; English is infamous for its sequences of nouns where the reader or computer must determine what describes what.&nbsp; For example, we can figure out “airport long term car park courtesy vehicle pickup point” from our knowledge of airports and car rentals, but can a computer figure out which word describes which other word or group of words enough to translate it?&nbsp; Machine translation would have more luck with the less common but still correct English phrasing “pickup point for the courtesy vehicles of the airport’s long-term car park”.</span></p><p><span style="font-size:16px;"><br></span></p><p><span style="font-size:16px;">But before you decide to write all your original documents in Lithuanian rather than English to improve translation quality, know that it is possible to write in English in a way that is easier to translate.</span></p><p><span>Microsoft publishes some style guides with sections on how to author documents so that machine translation has fewer errors and is easier to understand.&nbsp; You can find them <a href="https://www.microsoft.com/en-us/language/StyleGuides" title="here" target="_blank" rel="">here</a>.</span></p><p style="font-size:11pt;"><br></p><p><span style="font-size:16px;">Style guides for machine translation are similar to style guides for writing for ESL audiences, where some English language constructs that are potentially ambiguous for non-native speakers are avoided.&nbsp; Within the Microsoft style guides are some tips about writing so that machine translation will have higher quality.</span></p><p style="font-size:11pt;"><a href="https://docs.microsoft.com/en-us/style-guide/global-communications/writing-tips"><span style="font-size:16px;">https://docs.microsoft.com/en-us/style-guide/global-communications/writing-tips</span></a></p><p style="font-size:11pt;"><br></p><p><span style="font-size:16px;">Some of the tips seem to have been written at the time of earlier versions of machine translation which had problems that are less common now, but there is no harm in reducing ambiguity.&nbsp; The tips include:</span></p><ul><li><span>Use articles. Does “Empty container” mean “Empty the container” or “The empty container”?&nbsp; Articles (determiners) make it explicit.</span></li><li><span>Reduce chains of modifiers. Instead of &nbsp;“well thought-out Windows migration project plan” say “a project plan to migrate Windows that's well thought out”</span></li><li><span>Keep adjectives and adverbs close to the words they modify. Pay particular attention to the placement of “only”.</span></li><li><span>·Use simple sentence structures. Write sentences that use standard word order (that is, subject + verb + object) whenever possible.</span></li><li><span>Use words ending in –ing carefully. A word ending in –ing can be a verb, an adjective, or a noun. Use the sentence structure and optional words to clarify the role of the –ing word.</span></li><li><span>Use words ending in –ed carefully. A word ending in -ed can be a modifier or part of a verb phrase. Use the sentence structure and optional words to clarify the role of the –ed word.</span></li><ul><li><span>Add an article (a, an, the, this) before or after the –ed word. “They have <b>an</b> added functionality.”</span></li><li><span>Add a form of the verb be. “Configure limits for the backup that are based on the amount of storage space available.”</span></li></ul></ul><p><span style="font-size:16px;"><br></span></p><p><span style="font-size:16px;">I would probably add a few more tips.&nbsp; Be careful with the scoping of negation and of adjectives/adverbs (often a word can be one or the other).&nbsp; Keep the negation or the adjective close to what it modifies, whether a word, a noun phrase, a clause or the verb, and try to phrase it so it is not easily mistaken.&nbsp; An example of negation scoping is “All that glitters is not gold”.&nbsp; Is it saying that everything that glitters is made of something other than gold?&nbsp; It might, but it is probably asserting that the set of all items that glitter does not coincide with the set of gold items. It depends on whether it means {all that glitters} is-not gold, or {all that glitters} is not-gold.&nbsp; The “not” could be associated with “is” or with “gold”.&nbsp; I am tempted to wander into a digression into predicate logic or set theory, but that would take us away from the scoping problem.&nbsp; Not all who wander are lost 😉</span></p><p><span style="font-size:16px;"><br></span></p><p><span style="font-size:16px;">Also be careful with words that can have several senses.&nbsp; Instead look for a different word with fewer senses.</span></p></div>
</div></div></div><div data-element-id="elm_nLGIKkQiuryf0KgItbzUtw" data-element-type="heading" class="zpelement zpelem-heading "><style> [data-element-id="elm_nLGIKkQiuryf0KgItbzUtw"].zpelem-heading { border-radius:1px; } </style><h2 class="zpheading zpheading-style-none zpheading-align-left " data-editor="true"><div><p style="font-size:11pt;"><b><span style="font-size:16px;font-family:&quot;Work Sans&quot;;color:rgb(11, 27, 45);">Cultural differences</span></b></p></div></h2></div>
<div data-element-id="elm_sb6NuRzw4hxPJlZcs4IvTw" data-element-type="text" class="zpelement zpelem-text "><style> [data-element-id="elm_sb6NuRzw4hxPJlZcs4IvTw"].zpelem-text{ border-radius:1px; } </style><div class="zptext zptext-align-left " data-editor="true"><div style="color:inherit;"><div style="color:inherit;"><p><span style="font-size:16px;">Some translation issues are not easily solved with these strategies.&nbsp; This is because in addition to communicating across languages, you may be communicating across cultures.</span></p><p><span style="font-size:16px;"><br></span></p><p><span style="font-size:16px;">There are translations that correct but are hard to understand or insensitive for cultural reasons.&nbsp; Some of them you can change before translation takes place, others can be caught during post-editing, but there is another alternative.</span></p><p><span style="font-size:16px;">For example, if you talk about hitting a homerun, or about pulling the trigger, or call two things kissing cousins, these are cultural references that may be common in your country but may be hard to understand elsewhere even with a correct translation.&nbsp; More recent translation engines are better at common idioms, but it’s still risky.&nbsp; And it’s not just American English that draws from its culture.&nbsp; For example, Japanese has a term “mikka bouzu” meaning “three-day monk”.&nbsp; Some knowledge of Buddhism and Japanese culture is required to understand this is someone who gives up too easily.&nbsp; German has a word “Deppenleerzeichen” meaning “Idiot’s space”, a derogatory term for putting spaces between words that the German language normally sticks together in a large compound word.&nbsp; Some knowledge of German syntax is required.</span></p><p><span style="font-size:16px;"><br></span></p><p><span style="font-size:16px;">Some more difficult cultural issues are better caught in post-editing.&nbsp; Some correct translations are to be avoided because they sound like slogans used by political parties or extremist groups.&nbsp; Catch me some day in person and I might tell you about some big yikes.</span></p><p><span style="font-size:16px;"><br></span></p><p><span style="font-size:16px;">Another issue has to do with tone.&nbsp; A perfectly correct translation of communication written in German may sound inappropriate or even rude when translated to Japanese.&nbsp; That is because the German culture is comfortable with directness while Japanese employees are more comfortable with more indirect phrasing.&nbsp; Some re-training of the model using professionally translated text where the tone of business communication has been adjusted to be culturally appropriate is useful.&nbsp; However in some cultures such as Korean, verb forms and vocabulary depend on relative status of the writer and the reader, whether peer or subordinate, or on age difference.&nbsp; This is called honorifics or register.&nbsp; Similarly, many languages have differences based on the gender of the person being addressed or of the person who is speaking or writing.&nbsp; This is context that the computer does not have, so its&nbsp; phrasing may violate cultural norms.</span></p><p><span style="font-size:16px;"><br></span></p><p><span style="font-size:16px;">When it comes to these cultural norms for things like tone, post-editing is the only way to fix these errors but correcting these type of errors can be time consuming, inconsistent with the “limited editing”&nbsp; that was recommended.&nbsp; Another alternative is to educate the readers of the translations about the cultural differences and explain that messages from that country may be expressed differently based on their different culture, and that no offense is intended.&nbsp; Educating the readers about cultural differences may be more cost effective than adapting all translations to the different cultural context.</span></p></div>
</div></div></div></div></div></div></div></div>]]></content:encoded><pubDate>Thu, 04 Aug 2022 14:03:43 -0400</pubDate></item><item><title><![CDATA[Language-dependent JSON column formatting using the @lcid token]]></title><link>https://blog.icefire.ca/blogs/post/language-dependent-json-column-formatting-using-the-lcid-token</link><description><![CDATA[Use JSON column formatting to display different text in different languages in SharePoint using the new @lcid token.]]></description><content:encoded><![CDATA[<div class="zpcontent-container blogpost-container "><div data-element-id="elm_LTnE7VNOSgasOwtENre72w" data-element-type="section" class="zpsection "><style type="text/css"></style><div class="zpcontainer-fluid zpcontainer"><div data-element-id="elm_LffkkLsnTCWTmi-PKYgBMg" data-element-type="row" class="zprow zprow-container zpalign-items- zpjustify-content- " data-equal-column=""><style type="text/css"></style><div data-element-id="elm_UtIjmF5hR2SXnvR9kU_VRw" data-element-type="column" class="zpelem-col zpcol-12 zpcol-md-12 zpcol-sm-12 zpalign-self- "><style type="text/css"></style><div data-element-id="elm_CVjGMNdsS6iePgZdenIIaA" data-element-type="text" class="zpelement zpelem-text "><style> [data-element-id="elm_CVjGMNdsS6iePgZdenIIaA"].zpelem-text{ border-radius:1px; } </style><div class="zptext zptext-align-center " data-editor="true"><div style="color:inherit;"><div style="color:inherit;"><div style="color:inherit;"><p style="text-align:left;">This is an update to my earlier blog post “<a href="https://blog.icefire.ca/blogs/post/json-for-different-text-in-different-languages" target="_blank" rel="">JSON for different text in different languages</a>”, where JSON column formatting is used to display different text in different languages. &nbsp;Please read that post before reading this one.&nbsp;</p><p style="text-align:left;"><span style="font-size:16px;">Since that post was published, a new “@lcid” token has become available.&nbsp; <a href="https://github.com/pnp/List-Formatting/tree/master/column-samples/number-localization" title="There is a sample here" target="_blank" rel="">There is a sample here</a>&nbsp;<span style="color:inherit;">by theChrisKent, and he demonstrates it in a <a href="https://www.youtube.com/watch?v=j6pvLx7qdCE" title="video here" target="_blank" rel="">video here</a></span></span></p><p style="text-align:left;"><span style="font-size:16px;">&nbsp;</span></p><p style="text-align:left;"><span style="font-size:16px;">The technique in the sample and the video sounds better than what I had described in my earlier post, doesn’t it?&nbsp; Except for one very important thing:&nbsp; the @lcid token does not match the user’s current language, or in technical terms the UI Culture.&nbsp; The @lcid token is the current locale of the session, sometimes called the region setting, which is a very different thing.&nbsp; It’s confusing because both the current <i>Language</i> and the current <i>Locale</i> use many of the same locale IDs, but the Language matches the language of user interface elements, while the locale only determines the formatting of dates, numbers, and currency.&nbsp; Locale has 209 possible values, but Language only supports 50 of these.&nbsp; The other 159 are not just other variants of the same language, they can be the same language but in a different jurisdiction with a different currency, the same language with different alphabets or alphabetical order, or other languages altogether.</span></p><p style="text-align:left;font-size:11pt;"><br></p><p style="text-align:left;"><span style="font-size:16px;">The user’s &nbsp;display Language, if it is set and matches one of the site’s alternate languages, always overrides the site’s base language, and the user can set any number of languages, letting an algorithm decide which one will be selected.&nbsp; Users can choose whether to have their Locale preference override the default site locale, and if they do they can only select one locale.&nbsp; The locale is independent of the language. You can set your language to Welsh and your locale to Urdu if you so wish.</span></p><p style="text-align:left;font-size:11pt;"><br></p><p style="text-align:left;"><span style="font-size:16px;">Language is a reliable indicator of the user’s current language on the current site.&nbsp; Locale is not.&nbsp; Using the @lcid token will choose the wrong language more often than not.</span></p><p style="text-align:left;font-size:11pt;"><br></p><p style="text-align:left;"><span style="font-size:16px;">Using the @lcid token only works if the Locale setting correctly reflects the current language.&nbsp; This is where PointFire 365 comes in.&nbsp; One of the lesser-known features of PointFire 365 is that it synchronizes the user’s locale with their language, and uses the user’s locale rather than the site locale.&nbsp; This is mostly so that date, number, and currency formatting will be correct for the user’s current language.&nbsp; Otherwise, you might get calendars with the names for months and days in the wrong language.&nbsp; Because of this PointFire 365 feature, the @lcid token will actually match the page language.</span></p><p style="text-align:left;"><span style="font-size:16px;">&nbsp;</span></p><p style="text-align:left;"><span style="font-size:16px;">So what does the use of the @lcid token in JSON column formatting look like in practice?&nbsp; Here is a new version of the sample code snippet that was used in the earlier post:</span></p></div>
</div></div></div></div><div data-element-id="elm_-0iSC6NZf04LIHl-Ji9S0A" data-element-type="image" class="zpelement zpelem-image "><style> @media (min-width: 992px) { [data-element-id="elm_-0iSC6NZf04LIHl-Ji9S0A"] .zpimage-container figure img { width: 624px !important ; height: 92px !important ; } } @media (max-width: 991px) and (min-width: 768px) { [data-element-id="elm_-0iSC6NZf04LIHl-Ji9S0A"] .zpimage-container figure img { width:624px ; height:92px ; } } @media (max-width: 767px) { [data-element-id="elm_-0iSC6NZf04LIHl-Ji9S0A"] .zpimage-container figure img { width:624px ; height:92px ; } } [data-element-id="elm_-0iSC6NZf04LIHl-Ji9S0A"].zpelem-image { border-radius:1px; } </style><div data-caption-color="" data-size-tablet="" data-size-mobile="" data-align="left" data-tablet-image-separate="false" data-mobile-image-separate="false" class="zpimage-container zpimage-align-left zpimage-size-original zpimage-tablet-fallback-original zpimage-mobile-fallback-original hb-lightbox " data-lightbox-options="
                type:fullscreen,
                theme:dark"><figure role="none" class="zpimage-data-ref"><span class="zpimage-anchor" role="link" tabindex="0" aria-label="Open Lightbox" style="cursor:pointer;"><picture><img class="zpimage zpimage-style-none zpimage-space-none " src="https://blog.icefire.ca/JSON-colon-formatting.png" width="624" height="92" loading="lazy" size="original" data-lightbox="true"></picture></span></figure></div>
</div><div data-element-id="elm_gBdYWzeKA1vJSzRHkAnPhA" data-element-type="text" class="zpelement zpelem-text "><style> [data-element-id="elm_gBdYWzeKA1vJSzRHkAnPhA"].zpelem-text{ border-radius:1px; } </style><div class="zptext zptext-align-left " data-editor="true"><div style="color:inherit;"><p><span style="font-size:16px;">Here, rather than checking the value of “Yes”, the JSON code is checking the value of @lcid.&nbsp; The code is just for two values of the field, “New application” and “Active”, but you get the idea.&nbsp; Here is what it looks like in English, French, and German.</span></p></div>
</div></div><div data-element-id="elm_C6RXMFdfPOpZZ8P6cHQkGQ" data-element-type="image" class="zpelement zpelem-image "><style> @media (min-width: 992px) { [data-element-id="elm_C6RXMFdfPOpZZ8P6cHQkGQ"] .zpimage-container figure img { width: 624px !important ; height: 176px !important ; } } @media (max-width: 991px) and (min-width: 768px) { [data-element-id="elm_C6RXMFdfPOpZZ8P6cHQkGQ"] .zpimage-container figure img { width:624px ; height:176px ; } } @media (max-width: 767px) { [data-element-id="elm_C6RXMFdfPOpZZ8P6cHQkGQ"] .zpimage-container figure img { width:624px ; height:176px ; } } [data-element-id="elm_C6RXMFdfPOpZZ8P6cHQkGQ"].zpelem-image { border-radius:1px; } </style><div data-caption-color="" data-size-tablet="" data-size-mobile="" data-align="left" data-tablet-image-separate="false" data-mobile-image-separate="false" class="zpimage-container zpimage-align-left zpimage-size-original zpimage-tablet-fallback-original zpimage-mobile-fallback-original hb-lightbox " data-lightbox-options="
                type:fullscreen,
                theme:dark"><figure role="none" class="zpimage-data-ref"><span class="zpimage-anchor" role="link" tabindex="0" aria-label="Open Lightbox" style="cursor:pointer;"><picture><img class="zpimage zpimage-style-box zpimage-space-none " src="https://blog.icefire.ca/JSON-formatting-translation-english.png" width="624" height="176" loading="lazy" size="original" data-lightbox="true"></picture></span></figure></div>
</div><div data-element-id="elm_IJuJCS-RufGWScxWmRU_Bw" data-element-type="spacer" class="zpelement zpelem-spacer "><style> div[data-element-id="elm_IJuJCS-RufGWScxWmRU_Bw"] div.zpspacer { height:30px; } @media (max-width: 768px) { div[data-element-id="elm_IJuJCS-RufGWScxWmRU_Bw"] div.zpspacer { height:calc(30px / 3); } } </style><div class="zpspacer " data-height="30"></div>
</div><div data-element-id="elm_3zKrLNAltVWagG0fJ_DovA" data-element-type="image" class="zpelement zpelem-image "><style> @media (min-width: 992px) { [data-element-id="elm_3zKrLNAltVWagG0fJ_DovA"] .zpimage-container figure img { width: 624px !important ; height: 166px !important ; } } @media (max-width: 991px) and (min-width: 768px) { [data-element-id="elm_3zKrLNAltVWagG0fJ_DovA"] .zpimage-container figure img { width:624px ; height:166px ; } } @media (max-width: 767px) { [data-element-id="elm_3zKrLNAltVWagG0fJ_DovA"] .zpimage-container figure img { width:624px ; height:166px ; } } [data-element-id="elm_3zKrLNAltVWagG0fJ_DovA"].zpelem-image { border-radius:1px; } </style><div data-caption-color="" data-size-tablet="" data-size-mobile="" data-align="left" data-tablet-image-separate="false" data-mobile-image-separate="false" class="zpimage-container zpimage-align-left zpimage-size-original zpimage-tablet-fallback-original zpimage-mobile-fallback-original hb-lightbox " data-lightbox-options="
                type:fullscreen,
                theme:dark"><figure role="none" class="zpimage-data-ref"><span class="zpimage-anchor" role="link" tabindex="0" aria-label="Open Lightbox" style="cursor:pointer;"><picture><img class="zpimage zpimage-style-box zpimage-space-none " src="https://blog.icefire.ca/JSON-formatting-translation-french.png" width="624" height="166" loading="lazy" size="original" data-lightbox="true"></picture></span></figure></div>
</div><div data-element-id="elm_asKxTKs0GYVi652Jw-a1zQ" data-element-type="spacer" class="zpelement zpelem-spacer "><style> div[data-element-id="elm_asKxTKs0GYVi652Jw-a1zQ"] div.zpspacer { height:30px; } @media (max-width: 768px) { div[data-element-id="elm_asKxTKs0GYVi652Jw-a1zQ"] div.zpspacer { height:calc(30px / 3); } } </style><div class="zpspacer " data-height="30"></div>
</div><div data-element-id="elm_4_rbl943cm3zFtQeLKhThg" data-element-type="image" class="zpelement zpelem-image "><style> @media (min-width: 992px) { [data-element-id="elm_4_rbl943cm3zFtQeLKhThg"] .zpimage-container figure img { width: 624px !important ; height: 178px !important ; } } @media (max-width: 991px) and (min-width: 768px) { [data-element-id="elm_4_rbl943cm3zFtQeLKhThg"] .zpimage-container figure img { width:624px ; height:178px ; } } @media (max-width: 767px) { [data-element-id="elm_4_rbl943cm3zFtQeLKhThg"] .zpimage-container figure img { width:624px ; height:178px ; } } [data-element-id="elm_4_rbl943cm3zFtQeLKhThg"].zpelem-image { border-radius:1px; } </style><div data-caption-color="" data-size-tablet="" data-size-mobile="" data-align="left" data-tablet-image-separate="false" data-mobile-image-separate="false" class="zpimage-container zpimage-align-left zpimage-size-original zpimage-tablet-fallback-original zpimage-mobile-fallback-original hb-lightbox " data-lightbox-options="
                type:fullscreen,
                theme:dark"><figure role="none" class="zpimage-data-ref"><span class="zpimage-anchor" role="link" tabindex="0" aria-label="Open Lightbox" style="cursor:pointer;"><picture><img class="zpimage zpimage-style-box zpimage-space-none " src="https://blog.icefire.ca/JSON-formatting-translation-german.png" width="624" height="178" loading="lazy" size="original" data-lightbox="true"></picture></span></figure></div>
</div><div data-element-id="elm_pMGxMmGiSLaR9vXJ5zN_hQ" data-element-type="spacer" class="zpelement zpelem-spacer "><style> div[data-element-id="elm_pMGxMmGiSLaR9vXJ5zN_hQ"] div.zpspacer { height:30px; } @media (max-width: 768px) { div[data-element-id="elm_pMGxMmGiSLaR9vXJ5zN_hQ"] div.zpspacer { height:calc(30px / 3); } } </style><div class="zpspacer " data-height="30"></div>
</div><div data-element-id="elm_VonfmjGQEypCeyzhe_PnRg" data-element-type="text" class="zpelement zpelem-text "><style> [data-element-id="elm_VonfmjGQEypCeyzhe_PnRg"].zpelem-text{ border-radius:1px; } </style><div class="zptext zptext-align-left " data-editor="true"><div style="color:inherit;"><div style="color:inherit;"><p><span style="font-size:16px;">The benefits of using this technique rather than the one in the earlier post are</span></p><ol><li><span style="color:inherit;">It is slightly shorter than before</span><br></li><li>It does not require an additional Yes/No column in the view</li><li>It can support all 50 SharePoint languages</li></ol><p><span style="font-size:16px;"><br></span></p><p><span style="font-size:16px;">The disadvantage (for some)</span></p><ul><li>It will usually not work without PointFire 365</li></ul><p><span style="font-size:16px;"><br></span></p><p>If you do not have PointFire 365, then the technique in the <a href="https://blog.icefire.ca/blogs/post/json-for-different-text-in-different-languages" title="earlier post" target="_blank" rel="">earlier post</a> is better.</p></div>
</div></div></div><div data-element-id="elm_j4T6mwQUKp8dA-rqBlj33g" data-element-type="text" class="zpelement zpelem-text "><style> [data-element-id="elm_j4T6mwQUKp8dA-rqBlj33g"].zpelem-text{ border-radius:1px; } </style><div class="zptext zptext-align-left " data-editor="true"><h1 style="line-height:1;"><span style="font-family:&quot;Work Sans&quot;;font-size:16px;font-weight:700;color:rgb(0, 0, 0);">Related Posts</span></h1><h1><div style="color:inherit;"></div></h1><h1><span style="font-family:&quot;Work Sans&quot;;font-size:16px;"><a href="https://blog.icefire.ca/blogs/post/localizing-group-by-headers-for-choice-columns-using-json-view-formatting" target="_blank" rel="">Localizing "group by" headers for choice columns using JSON view formatting in SharePoint Online</a></span></h1><h1><a href="https://blog.icefire.ca/blogs/post/language-dependent-json-column-formatting-using-the-lcid-token" target="_blank" rel="" style="font-family:&quot;Work Sans&quot;;font-size:16px;">Language-dependent JSON column formatting using the @lcid token</a><br></h1><h1 style="color:inherit;line-height:1;"><div style="color:inherit;"><div><div></div>
</div></div></h1><h1><span style="font-size:16px;font-family:&quot;Work Sans&quot;;"><a href="https://blog.icefire.ca/blogs/post/json-for-different-text-in-different-languages" target="_blank" rel="">JSON for different text in different languages</a></span></h1></div>
</div></div></div></div></div></div>]]></content:encoded><pubDate>Tue, 05 Jul 2022 11:34:48 -0400</pubDate></item></channel></rss>